-- Logs begin at Mon 2022-10-24 12:31:34 UTC, end at Mon 2022-10-24 13:32:43 UTC. -- Oct 24 13:03:47.499607 dv-cinder-862489-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 24 13:03:47.508949 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 24 13:03:47.510916 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 24 13:03:47 2022] *** Oct 24 13:03:47.510916 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 24 13:03:47.510916 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 24 13:03:47.510916 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: nodename: dv-cinder-862489-1-iscsi Oct 24 13:03:47.510916 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: machine: x86_64 Oct 24 13:03:47.510916 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: clock source: unix Oct 24 13:03:47.510916 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: pcre jit disabled Oct 24 13:03:47.510916 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: detected number of CPU cores: 4 Oct 24 13:03:47.510916 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: current working directory: / Oct 24 13:03:47.510916 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: detected binary path: /usr/bin/uwsgi-core Oct 24 13:03:47.510916 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: your processes number limit is 47680 Oct 24 13:03:47.511696 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: your memory page size is 4096 bytes Oct 24 13:03:47.511696 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: detected max file descriptor number: 2048 Oct 24 13:03:47.511696 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: lock engine: pthread robust mutexes Oct 24 13:03:47.511696 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: thunder lock: enabled Oct 24 13:03:47.511696 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 24 13:03:47.511696 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 24 13:03:47.550495 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: Python main interpreter initialized at 0x5616f414d9c0 Oct 24 13:03:47.550495 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: python threads support enabled Oct 24 13:03:47.550495 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: your server socket listen backlog is limited to 100 connections Oct 24 13:03:47.550495 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: your mercy for graceful operations on workers is 90 seconds Oct 24 13:03:47.550869 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: mapped 403077 bytes (393 KB) for 2 cores Oct 24 13:03:47.550960 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: *** Operational MODE: preforking *** Oct 24 13:03:47.551344 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: *** uWSGI is running in multiple interpreter mode *** Oct 24 13:03:47.551344 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: spawned uWSGI master process (pid: 103885) Oct 24 13:03:47.551376 dv-cinder-862489-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 24 13:03:47.552911 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: spawned uWSGI worker 1 (pid: 103886, cores: 1) Oct 24 13:03:47.552911 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: spawned uWSGI worker 2 (pid: 103887, cores: 1) Oct 24 13:03:47.552911 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 24 13:03:48.208044 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 13:03:48.209720 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 13:03:49.282531 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:03:49.282531 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: from cryptography.utils import int_from_bytes Oct 24 13:03:49.283148 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:03:49.283148 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: from cryptography.utils import int_from_bytes Oct 24 13:03:49.285030 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:03:49.285030 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: from cryptography.utils import int_from_bytes Oct 24 13:03:49.285488 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:03:49.285488 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: from cryptography.utils import int_from_bytes Oct 24 13:03:51.801075 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 13:03:51.801647 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 13:03:51.801834 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 13:03:51.802018 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 13:03:51.802388 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 13:03:51.802482 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 13:03:51.802562 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 13:03:51.802790 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.802877 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 13:03:51.803138 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.803239 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 13:03:51.803423 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 13:03:51.803508 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.803756 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.803842 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.804078 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.804171 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.804383 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.804468 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.804695 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.804789 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.805011 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.805106 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.805328 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.805413 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.805580 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.805665 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.805900 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.806011 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.806209 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862489-1-iscsi {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.806306 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.806492 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.806577 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.806802 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.806887 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.807119 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.807216 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862489-1-iscsi {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.807430 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.807522 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.807726 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.807816 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.808026 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.808127 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.808321 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.808412 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.808622 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.808805 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.808939 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.809240 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.809377 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.809546 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.809737 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.809856 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.810047 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.810142 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.810347 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.810454 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.810674 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.810777 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.811036 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.811288 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.811482 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.811634 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.811854 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.812045 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.812241 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.812398 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.812619 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.812768 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862489-1-iscsi {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.812980 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.813129 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.813306 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.813483 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.813483 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.813840 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862489-1-iscsi {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.813840 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.814176 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.814353 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.814536 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.814729 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.814904 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.814904 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.815264 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.816159 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.816294 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.816445 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.816701 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.816863 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.816995 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.817125 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.817248 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.817378 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.817533 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.817667 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.817802 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.817925 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.818045 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.818166 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.818298 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.818441 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.818578 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.818708 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.818858 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.818990 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.819127 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.819264 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.819387 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.819509 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.819637 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.819759 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.819886 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.820021 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.820144 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.820285 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.820412 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.820534 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.820672 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.820804 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.820927 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.821049 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.821172 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.821299 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.821472 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.821633 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.821758 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.821878 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.821999 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.822130 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.822258 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.822380 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.822507 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.822630 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.822752 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.822881 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.823009 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.823163 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.823296 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.823418 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.823622 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.823758 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.823880 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.824001 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.824120 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.824241 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.824370 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.824492 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.824613 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.824741 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.824863 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.824993 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.825123 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.825245 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.825374 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.825495 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.825624 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.825746 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.825916 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.826051 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.826306 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.826444 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.826567 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.826715 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.826849 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.826979 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.827190 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.827318 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.827506 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.827645 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.827809 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.827941 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.828109 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.828241 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.828419 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.828553 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.828720 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.828853 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.829019 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.829139 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.829261 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.829393 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.829541 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.829666 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.829840 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.829968 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.830150 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.830284 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.830448 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.830573 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.830744 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.830874 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.831112 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.831245 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.831520 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.831655 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.831827 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.831954 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.832133 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.832259 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.832436 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.832562 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.832734 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.832869 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.833036 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.833164 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.833338 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.833464 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.833640 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.833766 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.833943 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.834071 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.834250 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.834376 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.834544 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.834682 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.834839 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.834970 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.835177 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.835304 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.835457 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.835593 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.835761 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.835886 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.836061 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.836188 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.836359 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.836493 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.836660 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.836791 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.836955 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.837078 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.837252 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.837378 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.837551 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.837677 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.837847 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.837978 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.838142 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.838278 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.838439 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.838564 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.838735 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.838859 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.839033 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.839194 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.839361 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.839487 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.839654 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.839787 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.839952 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.840090 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.840252 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.840376 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.840547 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.840670 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.840840 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.840975 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.841132 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.841258 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.841425 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.841558 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.841717 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.841843 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.842012 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.842151 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.842306 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.842430 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.842595 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.842721 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.842890 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.843022 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.843214 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.843341 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.843513 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.843642 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.843810 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.843936 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.844104 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.844230 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.844420 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.844547 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.844735 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.844861 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.845037 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.845170 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.845338 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.845500 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.845624 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.845754 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.845933 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:03:51.846068 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.846260 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.846386 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.846586 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.846894 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.847019 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.847178 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.847391 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.847516 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.847701 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.847829 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.848021 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.848147 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.848325 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.848458 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.848629 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.848754 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.848932 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.849058 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.849244 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.849369 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.849556 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.849682 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.849883 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.850029 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.850159 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.850297 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.850457 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.850583 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.850767 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.850893 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.851090 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.851221 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.851407 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.851534 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.851718 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.851844 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.852033 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.852157 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.852335 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.852461 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.852649 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.852775 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.852976 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.853103 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.853283 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.853409 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.853588 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.853714 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.853899 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.854031 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.854202 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.854338 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.854504 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.854630 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.854806 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.854932 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.855166 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.855308 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.855474 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.855608 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.855776 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.855909 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.856085 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.856222 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.856388 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.856513 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.856704 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.856830 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.857009 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.857145 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.857312 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.857446 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.857616 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.857742 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.857919 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.858054 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.858260 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.858409 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.858533 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.858654 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.858819 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.858962 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.859143 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.859269 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.859448 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.859575 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.859761 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.859886 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.860073 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.860207 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.860381 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.860508 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.860685 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.860812 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.860989 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.861123 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.861287 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.861422 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.861584 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.861710 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.861880 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.862005 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.862182 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.862825 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.863130 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.863251 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.863443 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.863600 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.863748 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.863926 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.864053 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.864229 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.864355 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.864555 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.864690 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.864856 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.864983 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.865162 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.865288 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.865467 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.865596 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.865770 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.865897 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.866075 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.866201 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.866381 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.866516 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.866684 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.866818 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.866983 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.867150 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.867323 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.867461 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.867629 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.867769 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.867927 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.868053 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.868244 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.868380 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.868544 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.868670 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.868846 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.868977 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.869151 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.869284 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.869455 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.869581 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.869758 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.869891 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.870064 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.870189 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.870370 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.870495 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.870678 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.870805 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.870983 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.871128 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.871317 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.871446 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.871638 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.871950 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.872036 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.872261 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.872604 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.872900 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.873222 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.873544 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.873747 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.873872 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.873996 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.874146 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.874273 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.874449 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.874586 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.874749 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.874875 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.875045 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.875200 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.875364 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.875492 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.875667 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.875793 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.875968 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.876096 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.876266 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.876393 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.876562 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.876689 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.876859 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.876986 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.877157 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.877278 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.877472 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.877598 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.877771 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.878712 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.878855 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.878980 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.878980 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.879234 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.879357 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.879498 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.879622 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.879742 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.879864 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.880244 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.880370 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.880501 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.880677 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.880804 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.881019 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.881146 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.881323 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.881461 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.881629 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.881754 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.881942 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.882068 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.882247 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.882376 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.882554 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.882680 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.882859 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.882985 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.883189 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.883318 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.883505 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.883630 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.883810 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.883936 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.884117 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.884243 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.884419 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.884544 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.884736 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.884861 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.885040 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.885166 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.885354 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.885485 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.885657 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.885781 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.885967 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.886101 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.886275 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.886414 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.886595 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.886732 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.886900 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.887026 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.887237 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.887357 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.887543 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.887686 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.887853 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.887979 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.888156 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.888283 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.888465 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.888604 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.888770 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.888896 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.889074 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.889208 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.889387 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.889526 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.889692 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.889820 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.890001 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.890126 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.890301 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.890426 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.890616 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.890755 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.890917 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.891042 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.891257 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.891384 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.891554 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.891678 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.891862 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.891988 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.892171 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.892296 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.892489 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.892616 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.892790 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.892917 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.893097 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.893224 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.893414 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.893565 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.893800 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.893936 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.894153 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.894277 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.894458 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.894584 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.894760 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.894896 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.895100 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.895233 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.895386 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.895511 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.895700 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.895839 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.896004 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.896133 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.896307 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.896434 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.896607 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.896742 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.896914 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.897042 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.897217 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.897343 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.897515 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.897649 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.897812 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.897939 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.898117 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.898252 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.898432 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.898558 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.898735 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.898862 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.899035 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.899184 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.899370 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.899490 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.899665 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.899790 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.899963 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.900100 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.900278 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.900404 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.900581 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.900706 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.900878 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.901011 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.901177 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.901305 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.901476 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.901602 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.901790 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.901929 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.902097 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.902224 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.902392 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.902517 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.902695 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.902897 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.903022 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.903188 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.903361 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.903486 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.903665 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.903806 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.903973 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.904098 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.904276 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.904404 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.904581 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.904714 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.904887 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.905012 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.905189 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.905323 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.905493 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.905619 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.905797 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.905944 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.906103 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.906226 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.906393 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.906522 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.906698 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.906823 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.906999 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.907139 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.907327 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.907456 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.907632 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.907759 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.907930 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.908065 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.908234 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.908361 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.908541 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.908667 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.908848 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.909103 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.909277 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.909665 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.909816 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.909983 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.910138 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.910456 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.910589 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.910801 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.910938 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.911141 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.911271 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.911473 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.911615 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.911797 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.911922 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.912109 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.912244 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.912414 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.912552 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.912722 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.912849 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.913026 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.913158 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.913329 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.913454 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.913636 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.913763 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.913937 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.914062 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.914238 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.914361 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.914536 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.914661 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.914838 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.914962 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.915160 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.915296 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.915462 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.915586 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.915764 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.915887 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.916062 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.916196 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.916361 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.916484 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.916674 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.916832 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.916957 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.917090 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.917252 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.917377 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.917549 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.917674 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.917856 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.917989 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.918156 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.918288 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.918454 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.918580 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.918752 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.918887 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.919093 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.919234 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.919359 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.919488 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.919663 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.919790 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.920004 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.920132 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.920309 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.920436 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.920631 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.920763 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.920931 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.921057 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.921248 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.921373 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.921547 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.921674 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.921844 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.921971 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.922144 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.922285 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.922446 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.922572 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.922747 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.922879 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.923041 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.923197 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.923372 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.923498 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.923675 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.923799 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.923975 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.924109 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.924274 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.924407 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.924571 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.924697 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.925490 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.925616 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.925740 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.925861 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.925983 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.926105 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.926271 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.926400 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.926573 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.926699 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.926887 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.927027 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.927273 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.927412 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.927537 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.927659 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.927778 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.927899 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.928090 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.928217 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.928394 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.928523 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.928693 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.928820 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.929000 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.929128 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.929303 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.929430 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.929598 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.929731 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.929901 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.930026 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.930201 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.930326 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.930497 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.930634 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.930801 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.930926 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.931129 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.931258 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.931429 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.931569 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.931727 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.931854 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.932028 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.932155 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.932327 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.932462 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.932625 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.932752 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.932925 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.933051 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.933227 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.933365 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.933530 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.933657 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.933824 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.933956 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.934127 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.934258 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.934426 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.934560 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.934723 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.934844 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.935021 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.935181 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.935347 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.935472 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.935641 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.935766 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.935937 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.936065 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.936239 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.936366 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.936536 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.936673 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.936833 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.936959 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.937133 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.937260 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.937432 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.937566 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.937729 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.937850 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.938025 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.938152 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.938324 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.938464 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.938623 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.938747 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.938925 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.939075 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.939250 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.939388 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.939589 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.939715 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.939889 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.940014 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.940197 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.940323 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.941054 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.941186 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.941367 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.941494 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.941675 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.941810 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.941973 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.942107 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.942281 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.942443 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.942579 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.942756 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.942882 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.943103 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.943236 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.943394 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.943535 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.943703 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.943852 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.944013 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.944170 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.944298 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.944478 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.944606 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.944792 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.944920 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.945107 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.945253 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.945423 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.945582 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.945707 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.945819 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.946016 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.946156 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.946321 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.946449 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.946623 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.946750 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.946927 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.947086 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.947252 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.947382 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.947558 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.947693 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.947864 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.947993 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.948169 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.948296 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.948474 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.948600 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.948778 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.948905 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.949076 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.949203 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.949378 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.949506 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.949679 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.949814 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.949976 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.950103 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.950279 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.950396 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.950580 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.950706 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.950876 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.951003 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.951197 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.951326 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.951496 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.951626 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.951800 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.951927 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.952097 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.952232 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.952394 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.952527 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.952702 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.952828 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.953004 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.953139 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.953377 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.953502 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.953682 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.953809 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.953985 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.954121 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.954294 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.954419 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.954600 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.954726 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.954896 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.955036 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.955233 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.955358 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.955545 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.955673 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.955872 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.956028 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.956305 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.956430 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.956607 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.956734 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.956906 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.957033 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.957212 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.957346 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.957528 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.957646 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.957826 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.957954 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.958126 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.958252 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.958423 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.958549 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.958727 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.958853 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.959023 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.959177 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.959360 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.959499 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.959679 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.959805 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.959979 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.960107 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.960295 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.960431 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.960705 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.960831 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.961011 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.961139 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.961310 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.961446 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.961622 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.961747 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.961936 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.962077 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.962251 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.962378 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.962551 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.962686 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.962858 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.962984 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.963181 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.963310 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.963496 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.963636 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.963809 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.963935 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.964113 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.964239 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.964417 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.964551 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.964715 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.964843 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.965030 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.965157 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.965338 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.965470 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.965640 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.965767 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.965957 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.966082 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.966281 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.966407 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.966588 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.966719 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.966885 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.967012 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.967278 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.967414 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.967595 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.967715 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.967893 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.968028 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.968188 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.968316 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.968489 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.968615 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.968786 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.968926 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.969080 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.969207 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.969391 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.969519 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.969686 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.969825 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.969989 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.970140 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.970312 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.970474 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.970599 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.970732 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.970855 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.970977 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.971153 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.971279 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.971468 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.971603 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.971788 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.971907 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.972103 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.972230 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.972410 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.972545 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.972721 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.972848 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.973033 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.973160 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.973332 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.973460 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.973648 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.973775 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.973949 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.974068 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.974248 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.974375 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.974543 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.974678 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.974841 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.974976 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.975198 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.975327 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.975498 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.975637 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.975817 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.975953 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.976139 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.976266 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.976446 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.976570 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.976751 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.976886 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.977077 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.977202 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.977394 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.977519 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.977699 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.977827 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.978000 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.978125 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.978311 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.978438 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.978627 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.978754 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.978924 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.979098 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.979244 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.979371 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.979545 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.979673 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.979841 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.979969 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.980138 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.980264 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.980433 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.980568 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.980732 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.980865 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.981023 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.981150 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.981316 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.981444 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.981609 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.981743 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.981904 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.982044 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.982203 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.982331 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.982501 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.982627 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.982799 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.982932 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.983115 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.983244 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.983413 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.983548 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.983709 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.983848 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.984011 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.984147 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.984312 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.984439 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.984611 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.984751 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.984921 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.985048 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.985234 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.985358 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.985541 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.985667 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.985854 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.985979 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.986161 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.986287 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.986468 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.986596 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.986776 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.986902 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.987107 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.987757 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.987954 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.988338 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.988478 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.988602 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.988725 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.988884 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.989027 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.989188 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.989317 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.989501 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.989629 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.989814 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.990031 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.990158 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.990356 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.990629 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.990761 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.990957 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.991121 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.991287 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.991414 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.991592 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.991718 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.991899 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.992025 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.992204 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.992332 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.992508 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.992636 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.992814 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.992941 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.993116 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.993243 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.993420 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.993556 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.993724 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.993852 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.994048 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.994182 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.994366 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.994501 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.994673 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.994807 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.994981 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.995159 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.995365 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.995491 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.995614 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.995737 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.995924 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.996050 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.996236 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.996367 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.996543 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.996672 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.996851 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.996991 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.997159 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.997287 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.997466 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.997593 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.997772 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.997908 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.998077 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.998212 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.998384 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.998502 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.998687 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.998824 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.998990 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.999137 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.999317 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.999445 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.999616 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.999745 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:51.999920 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.000056 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.000229 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.000356 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.000539 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.000667 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.000850 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.000984 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.001154 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.001282 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.001461 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.001590 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.001770 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.001899 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.002078 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.002280 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.002416 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.002588 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.002971 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.003789 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.003789 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.004021 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.004146 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.004276 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.004399 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.004521 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.004703 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.004839 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.005286 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.005417 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.005587 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.005723 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.005936 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.006071 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.006196 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.006317 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.006487 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.006621 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.006785 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.006914 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.007110 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.007251 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.007418 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.007545 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.007718 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.007844 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.008031 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.008149 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.008333 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.008458 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.008648 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.008855 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.008982 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.009192 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.009472 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.009599 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.009805 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.009931 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.010120 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.010245 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.010429 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.010563 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.010730 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.010857 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.011044 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.011193 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.011368 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.011508 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.011668 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.011795 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.011977 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.012104 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.012280 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.012419 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.012576 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.012710 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.012875 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.013010 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.013178 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.013314 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.013477 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.013604 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.013773 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.013898 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.014075 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.014203 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.014373 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.014508 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.014679 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.014816 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.014980 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.015126 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.015301 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.015427 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.015599 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.015726 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.015905 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.016034 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.016210 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.016337 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.016507 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.016636 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.016812 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.016948 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.017107 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.017220 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.017405 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.017505 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.017701 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.017790 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.018003 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.018091 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.018302 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.018418 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.018663 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.018899 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.019029 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.019275 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.019415 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.019585 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.019714 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.019887 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.020015 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.020206 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.020332 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.020506 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.020634 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.020805 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.020932 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.021104 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.021238 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.021408 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.021533 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.021712 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.021838 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.022015 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.022153 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.022320 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.022447 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.022625 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.022750 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.022957 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.023132 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.023293 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.023506 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.023820 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.023950 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.024138 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.024273 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.024453 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.024579 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.024773 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.024899 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.025101 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.025227 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.025349 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.025471 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.025647 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.025775 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.025964 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.026110 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.026276 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.026403 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.026580 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.026705 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.026881 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.027007 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.027206 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.027334 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.027510 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.027646 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.027810 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.027936 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.028112 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.028252 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.028415 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.028554 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.028715 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.028834 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.029016 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.029142 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.029319 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.029453 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.029615 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.029740 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.029916 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.030042 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.030218 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.030347 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.030519 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.030644 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.030831 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.030958 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.031194 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.031326 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.031508 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.031634 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.031818 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.031944 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.032130 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.032264 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.032434 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.032566 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.032737 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.032871 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.033041 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.033169 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.033344 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.033473 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.033652 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.033791 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.033971 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.034107 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.034336 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.034473 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.034635 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.034769 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.034942 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.035307 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.035619 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.035756 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.035933 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.036074 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.036253 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.036374 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.036560 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.036687 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.036876 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.037002 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.037190 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.037322 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.037500 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.037629 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.037808 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.037934 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.038109 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.038234 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.038423 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.038547 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.038748 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.038887 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.039103 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.039233 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.039405 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.039545 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.039705 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.039831 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.040002 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.040129 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.040300 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.040436 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.040602 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.040731 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.040907 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.041033 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.041208 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.041341 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.041506 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.041633 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.041803 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.041938 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.042104 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.042231 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.042398 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.042523 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.042694 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.042822 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.042992 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.043138 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.043315 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.043442 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.043615 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.043752 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.043911 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.044036 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.044208 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.044335 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.044506 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.044624 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.044810 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.044939 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.045111 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.045238 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.045412 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.045548 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.045699 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.045822 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.046010 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.046136 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.046312 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.046448 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.046609 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.046734 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.046907 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.047035 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.047231 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.047370 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.047531 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.047656 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.047857 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.047984 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.048164 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.048298 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.048480 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.048605 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.048785 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.048912 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.049094 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.049220 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.049396 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.049521 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.049707 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.050345 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.050585 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.050710 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.050898 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.051131 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.051269 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.051393 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.051525 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.051649 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.051822 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.051956 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.052127 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.052255 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.052434 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.052562 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.052740 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.052866 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.053041 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.053177 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.053341 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.053467 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.053653 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.053778 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.053969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.054174 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.054300 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.054424 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.054575 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.054694 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.054886 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.055023 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.055226 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.055353 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.055534 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.055660 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.055841 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.055970 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.056154 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.056287 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.056468 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.056594 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.056774 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.056900 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.057076 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.057201 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.057380 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.057506 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.057683 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.057816 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.057986 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.058111 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.058290 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.058424 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.058594 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.058720 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.058902 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.059029 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.059235 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.059373 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.059552 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.059677 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.059867 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.059993 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.060171 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.060308 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.060480 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.060606 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.060796 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.060922 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.061115 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.061249 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.061430 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.061547 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.061833 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.061957 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.062078 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.062182 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.062378 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.062499 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.062687 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.062801 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.062989 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.063168 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.063281 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103886) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 13:03:52.063387 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:03:52.063564 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103887) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 13:03:52.216088 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO dbcounter [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] Registered counter for database nova_api Oct 24 13:03:52.216464 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO dbcounter [None req-2c5c59b5-95c5-42c6-8f59-53dbb33d66e0 None None] Registered counter for database nova_api Oct 24 13:03:52.238451 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_db.sqlalchemy.engines [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:03:52.240681 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG oslo_db.sqlalchemy.engines [None req-2c5c59b5-95c5-42c6-8f59-53dbb33d66e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:03:52.245200 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG dbcounter [-] [103886] Writer thread running {{(pid=103886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:03:52.247389 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG dbcounter [-] [103887] Writer thread running {{(pid=103887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:03:52.302188 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.context [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),acff14a8-a78e-4539-91cc-32485716dc9b(cell1) {{(pid=103886) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 13:03:52.304203 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.context [None req-2c5c59b5-95c5-42c6-8f59-53dbb33d66e0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),acff14a8-a78e-4539-91cc-32485716dc9b(cell1) {{(pid=103887) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 13:03:52.306019 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:03:52.306492 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:03:52.308038 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG oslo_concurrency.lockutils [None req-2c5c59b5-95c5-42c6-8f59-53dbb33d66e0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:03:52.308156 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:03:52.308512 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG oslo_concurrency.lockutils [None req-2c5c59b5-95c5-42c6-8f59-53dbb33d66e0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:03:52.308837 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:03:52.309281 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:03:52.310111 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG oslo_concurrency.lockutils [None req-2c5c59b5-95c5-42c6-8f59-53dbb33d66e0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:03:52.310926 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG oslo_concurrency.lockutils [None req-2c5c59b5-95c5-42c6-8f59-53dbb33d66e0 None None] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:03:52.311280 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:03:52.311447 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG oslo_concurrency.lockutils [None req-2c5c59b5-95c5-42c6-8f59-53dbb33d66e0 None None] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:03:52.313268 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO dbcounter [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] Registered counter for database nova_cell0 Oct 24 13:03:52.313373 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG oslo_concurrency.lockutils [None req-2c5c59b5-95c5-42c6-8f59-53dbb33d66e0 None None] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103887) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:03:52.315327 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO dbcounter [None req-2c5c59b5-95c5-42c6-8f59-53dbb33d66e0 None None] Registered counter for database nova_cell0 Oct 24 13:03:52.317546 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO dbcounter [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] Registered counter for database nova_cell1 Oct 24 13:03:52.319595 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO dbcounter [None req-2c5c59b5-95c5-42c6-8f59-53dbb33d66e0 None None] Registered counter for database nova_cell1 Oct 24 13:03:52.324697 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_db.sqlalchemy.engines [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:03:52.326388 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_db.sqlalchemy.engines [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:03:52.327803 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG oslo_db.sqlalchemy.engines [None req-2c5c59b5-95c5-42c6-8f59-53dbb33d66e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:03:52.329596 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG oslo_db.sqlalchemy.engines [None req-2c5c59b5-95c5-42c6-8f59-53dbb33d66e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:03:52.330407 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG dbcounter [-] [103886] Writer thread running {{(pid=103886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:03:52.336072 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG dbcounter [-] [103887] Writer thread running {{(pid=103887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:03:52.337603 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG dbcounter [-] [103887] Writer thread running {{(pid=103887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:03:52.469561 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG dbcounter [-] [103886] Writer thread running {{(pid=103886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:03:52.479388 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO dbcounter [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] Registered counter for database nova_cell0 Oct 24 13:03:52.483041 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO dbcounter [None req-2c5c59b5-95c5-42c6-8f59-53dbb33d66e0 None None] Registered counter for database nova_cell0 Oct 24 13:03:52.488842 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_db.sqlalchemy.engines [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103886) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:03:52.491273 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG oslo_db.sqlalchemy.engines [None req-2c5c59b5-95c5-42c6-8f59-53dbb33d66e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103887) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:03:52.493557 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG dbcounter [-] [103886] Writer thread running {{(pid=103886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:03:52.495584 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG dbcounter [-] [103887] Writer thread running {{(pid=103887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:03:52.829265 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: WARNING keystonemiddleware.auth_token [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:03:52.834914 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: WARNING keystonemiddleware.auth_token [None req-2c5c59b5-95c5-42c6-8f59-53dbb33d66e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:03:52.836970 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: WARNING keystonemiddleware.auth_token [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:03:52.842134 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: WARNING keystonemiddleware.auth_token [None req-2c5c59b5-95c5-42c6-8f59-53dbb33d66e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:03:53.179952 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: WARNING keystonemiddleware.auth_token [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:03:53.185854 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: WARNING keystonemiddleware.auth_token [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:03:53.185978 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: WARNING keystonemiddleware.auth_token [None req-2c5c59b5-95c5-42c6-8f59-53dbb33d66e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:03:53.191141 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5616f414d9c0 pid: 103886 (default app) Oct 24 13:03:53.192058 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: WARNING keystonemiddleware.auth_token [None req-2c5c59b5-95c5-42c6-8f59-53dbb33d66e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:03:53.193202 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:03:53.194378 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001713 Oct 24 13:03:53.194788 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Mon Oct 24 13:03:53 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:03:53.197315 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5616f414d9c0 pid: 103887 (default app) Oct 24 13:05:14.952154 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:05:14.954255 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002534 Oct 24 13:05:14.954947 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 24 13:05:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:05:14.966947 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG dbcounter [-] [103887] Writing DB stats nova_api:SELECT=3 {{(pid=103887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:14.967936 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG dbcounter [-] [103887] Writing DB stats nova_cell0:SELECT=3 {{(pid=103887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:14.969947 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG dbcounter [-] [103887] Writing DB stats nova_cell1:SELECT=3 {{(pid=103887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:14.972077 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG dbcounter [-] [103887] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:15.856437 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-eeb48aca-7929-4e76-9dff-e1c4b4eaf5d6 admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:05:15.890914 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-eeb48aca-7929-4e76-9dff-e1c4b4eaf5d6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.928904 Oct 24 13:05:15.894189 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1292 bytes} [Mon Oct 24 13:05:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:05:18.539743 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:05:18.540740 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-983b2006-d4f7-4d20-83d8-58209c48dfb2 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 24 13:05:18.541331 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 24 13:05:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:05:19.010511 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-4d1b121a-728a-4c49-b802-6f5e3b08c41c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 256, "id": "c1"}} {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:05:19.059615 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-4d1b121a-728a-4c49-b802-6f5e3b08c41c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.511607 Oct 24 13:05:19.060180 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Oct 24 13:05:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:05:19.073960 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG dbcounter [-] [103886] Writing DB stats nova_api:SELECT=3 {{(pid=103886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:19.074777 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG dbcounter [-] [103886] Writing DB stats nova_cell1:SELECT=3 {{(pid=103886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:19.077175 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG dbcounter [-] [103886] Writing DB stats nova_cell0:SELECT=3 {{(pid=103886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:19.079321 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG dbcounter [-] [103886] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:19.287265 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-e9971d4c-b322-44ad-b07d-40a1616edc50 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:05:19.355912 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-e9971d4c-b322-44ad-b07d-40a1616edc50 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287221 Oct 24 13:05:19.356490 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1336 bytes} [Mon Oct 24 13:05:19 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:05:22.020935 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-4d1b121a-728a-4c49-b802-6f5e3b08c41c admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:05:22.021959 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-4d1b121a-728a-4c49-b802-6f5e3b08c41c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 24 13:05:22.022592 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 24 13:05:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:05:22.690960 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-1b0084ee-0a12-40fb-8a80-79c859d2948d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d1", "swap": 0, "vcpus": 1, "disk": 5, "os-flavor-access:is_public": true, "ram": 512, "name": "ds512M"}} {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:05:22.731209 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-1b0084ee-0a12-40fb-8a80-79c859d2948d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.702534 Oct 24 13:05:22.735103 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Oct 24 13:05:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:05:22.745407 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-618abcfb-ee74-47c9-be07-7c308d175fa9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:05:22.791776 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-618abcfb-ee74-47c9-be07-7c308d175fa9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050159 Oct 24 13:05:22.792680 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1336 bytes} [Mon Oct 24 13:05:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:05:25.409281 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-1b0084ee-0a12-40fb-8a80-79c859d2948d admin admin] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:05:25.410302 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-1b0084ee-0a12-40fb-8a80-79c859d2948d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 24 13:05:25.410713 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 24 13:05:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:05:25.845569 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-0ce84d69-dd0d-4481-bbb2-69a01b136b7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 1024, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "name": "ds1G"}} {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:05:25.865546 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-0ce84d69-dd0d-4481-bbb2-69a01b136b7e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.447835 Oct 24 13:05:25.866354 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Oct 24 13:05:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:05:25.879192 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-98ae9971-4355-41ef-87d1-1f4b1252991c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:05:25.911792 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-98ae9971-4355-41ef-87d1-1f4b1252991c admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037416 Oct 24 13:05:25.913449 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1336 bytes} [Mon Oct 24 13:05:25 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:05:28.560909 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-0ce84d69-dd0d-4481-bbb2-69a01b136b7e admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:05:28.561951 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-0ce84d69-dd0d-4481-bbb2-69a01b136b7e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 24 13:05:28.562383 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 24 13:05:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:05:28.981267 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-6f035ab4-0cef-452d-a1f2-a3e0fa2a4a32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "disk": 10, "ram": 2048, "os-flavor-access:is_public": true, "name": "ds2G"}} {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:05:29.002151 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-6f035ab4-0cef-452d-a1f2-a3e0fa2a4a32 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.433217 Oct 24 13:05:29.002697 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Oct 24 13:05:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:05:29.015417 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-13c2da33-d48b-4174-a2e6-685351d30b61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:05:29.043617 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-13c2da33-d48b-4174-a2e6-685351d30b61 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032120 Oct 24 13:05:29.044295 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1336 bytes} [Mon Oct 24 13:05:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:05:31.699929 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-6f035ab4-0cef-452d-a1f2-a3e0fa2a4a32 admin admin] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:05:31.700936 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-6f035ab4-0cef-452d-a1f2-a3e0fa2a4a32 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Oct 24 13:05:31.701335 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 24 13:05:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:05:32.113138 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-15a3f4df-be37-4dcb-80b8-5aad2d608e85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "vcpus": 4}} {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:05:32.131990 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-15a3f4df-be37-4dcb-80b8-5aad2d608e85 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.424194 Oct 24 13:05:32.132542 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Oct 24 13:05:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 13:05:32.148578 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-7ce57219-bcd9-4e47-9e3c-f1db6d60b483 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:05:32.178217 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-7ce57219-bcd9-4e47-9e3c-f1db6d60b483 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034606 Oct 24 13:05:32.178891 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1336 bytes} [Mon Oct 24 13:05:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:05:35.290441 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-15a3f4df-be37-4dcb-80b8-5aad2d608e85 admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:05:35.291518 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-15a3f4df-be37-4dcb-80b8-5aad2d608e85 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 24 13:05:35.291946 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 24 13:05:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:05:35.727688 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-7d255888-47f7-4e37-addf-608fce83611c admin admin] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:05:35.752849 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-7d255888-47f7-4e37-addf-608fce83611c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.454198 Oct 24 13:05:35.753390 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1292 bytes} [Mon Oct 24 13:05:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:05:38.691258 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-15a3f4df-be37-4dcb-80b8-5aad2d608e85 admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:05:38.692266 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-15a3f4df-be37-4dcb-80b8-5aad2d608e85 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Oct 24 13:05:38.692700 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 24 13:05:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:05:39.096519 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-12d24792-79fe-4671-ae58-745aa1a1c327 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "swap": 0, "ram": 512, "disk": 1}} {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:05:39.116795 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-12d24792-79fe-4671-ae58-745aa1a1c327 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.417964 Oct 24 13:05:39.117439 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Oct 24 13:05:38 2022] POST /compute/v2.1/flavors => generated 402 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:05:39.130391 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-6dc3eb3c-1b20-40d3-a97d-e59d88ab80d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:05:39.157049 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-6dc3eb3c-1b20-40d3-a97d-e59d88ab80d2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030702 Oct 24 13:05:39.157840 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1333 bytes} [Mon Oct 24 13:05:39 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:05:41.771081 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-12d24792-79fe-4671-ae58-745aa1a1c327 admin admin] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:05:41.772214 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-12d24792-79fe-4671-ae58-745aa1a1c327 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Oct 24 13:05:41.772619 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 24 13:05:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:05:42.192871 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-379ed95f-d8aa-4bbc-bb4c-498b4e411b04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 20, "rxtx_factor": 1.0, "id": "2"}} {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:05:42.212865 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-379ed95f-d8aa-4bbc-bb4c-498b4e411b04 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.433710 Oct 24 13:05:42.213721 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Oct 24 13:05:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 13:05:42.227695 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-27618109-8d08-48a3-9073-16e06217eb48 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:05:42.254985 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-27618109-8d08-48a3-9073-16e06217eb48 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030852 Oct 24 13:05:42.257938 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1333 bytes} [Mon Oct 24 13:05:42 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:05:44.919520 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-379ed95f-d8aa-4bbc-bb4c-498b4e411b04 admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:05:44.920177 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-379ed95f-d8aa-4bbc-bb4c-498b4e411b04 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 24 13:05:44.920889 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 24 13:05:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:05:45.359479 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-4d904c6f-053b-4e7b-9250-d1ac8c470f56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 40, "ram": 4096, "swap": 0, "name": "m1.medium", "vcpus": 2, "os-flavor-access:is_public": true, "id": "3"}} {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:05:45.385410 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-4d904c6f-053b-4e7b-9250-d1ac8c470f56 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.458109 Oct 24 13:05:45.386338 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Oct 24 13:05:44 2022] POST /compute/v2.1/flavors => generated 406 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:05:45.398955 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-c0dcb3e2-e6fe-4535-b2e7-3d9eec24b3a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:05:45.403743 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG dbcounter [-] [103887] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:45.431242 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-c0dcb3e2-e6fe-4535-b2e7-3d9eec24b3a9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035827 Oct 24 13:05:45.432014 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1333 bytes} [Mon Oct 24 13:05:45 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:05:48.118219 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-4d904c6f-053b-4e7b-9250-d1ac8c470f56 admin admin] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:05:48.119275 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-4d904c6f-053b-4e7b-9250-d1ac8c470f56 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 24 13:05:48.119974 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 24 13:05:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:05:48.574946 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-bde804c9-63ad-4a97-9796-c3bf681264aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "os-flavor-access:is_public": true, "ram": 8192, "rxtx_factor": 1.0, "swap": 0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "m1.large"}} {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:05:48.595844 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-bde804c9-63ad-4a97-9796-c3bf681264aa admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.469787 Oct 24 13:05:48.596602 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Oct 24 13:05:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:05:48.608543 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-948321b3-668e-436d-8274-d35abf425a1e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:05:48.637663 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-948321b3-668e-436d-8274-d35abf425a1e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032731 Oct 24 13:05:48.651131 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1333 bytes} [Mon Oct 24 13:05:48 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:05:51.258675 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-bde804c9-63ad-4a97-9796-c3bf681264aa admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:05:51.259725 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-bde804c9-63ad-4a97-9796-c3bf681264aa admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 24 13:05:51.260660 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 24 13:05:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:05:51.718924 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-81f9a1f7-a336-4d6a-94de-a92d672c8363 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "ram": 16384, "id": "5", "os-flavor-access:is_public": true, "vcpus": 8}} {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:05:51.726441 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG dbcounter [-] [103886] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:05:51.743897 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-81f9a1f7-a336-4d6a-94de-a92d672c8363 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.477269 Oct 24 13:05:51.752253 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Oct 24 13:05:51 2022] POST /compute/v2.1/flavors => generated 408 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:05:51.757283 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-4b470d05-4a0b-4faf-a9e3-ba7a4a474177 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:05:51.783819 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-4b470d05-4a0b-4faf-a9e3-ba7a4a474177 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030434 Oct 24 13:05:51.784516 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1333 bytes} [Mon Oct 24 13:05:51 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:06:08.281248 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-81f9a1f7-a336-4d6a-94de-a92d672c8363 admin admin] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:06:08.282281 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-81f9a1f7-a336-4d6a-94de-a92d672c8363 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Oct 24 13:06:08.282703 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 24 13:06:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:06:08.293217 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG dbcounter [-] [103887] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=103887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:06:08.670034 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-ffdaf045-1baf-4831-90a4-d41953b8a19e admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:06:08.688525 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-ffdaf045-1baf-4831-90a4-d41953b8a19e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399687 Oct 24 13:06:08.689054 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1292 bytes} [Mon Oct 24 13:06:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:06:09.992197 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-81f9a1f7-a336-4d6a-94de-a92d672c8363 admin admin] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:06:09.993188 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-81f9a1f7-a336-4d6a-94de-a92d672c8363 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 24 13:06:09.993584 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 24 13:06:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:06:10.517764 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-af798dd3-e629-48b1-b8c7-d23229188b9b admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:06:10.522981 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.wsgi [None req-af798dd3-e629-48b1-b8c7-d23229188b9b admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 24 13:06:10.526162 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-af798dd3-e629-48b1-b8c7-d23229188b9b admin admin] Request method failure captured: Oct 24 13:06:10.526162 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 24 13:06:10.526162 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: Accept: application/json Oct 24 13:06:10.526162 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: Accept-Encoding: gzip, deflate Oct 24 13:06:10.526162 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: Connection: keep-alive Oct 24 13:06:10.526162 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: Content-Length: 0 Oct 24 13:06:10.526162 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: Host: 10.222.0.42 Oct 24 13:06:10.526162 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: Openstack-Api-Version: compute 2.92 Oct 24 13:06:10.526162 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: Openstack-System-Scope: None Oct 24 13:06:10.526162 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: User-Agent: python-novaclient Oct 24 13:06:10.526162 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Auth-Token: gAAAAABjVo3BLs0tNrXdMm7KNtYp7ZYXGrHWHylhYMuBC908lGn0JLf8s1apGS18ZKwt5P521Wwkl6tNAF-qOtUvvKZSDIBT1BaankGNGako2R4RtqFg_7jI3wJOV72o5saEK-0iJfgDh_k0YgDROvSasUQUpeu7pYL0b_ZOnJSU4Gl0o_kNeAU Oct 24 13:06:10.526162 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Domain-Id: None Oct 24 13:06:10.526162 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Domain-Name: None Oct 24 13:06:10.526162 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Identity-Status: Confirmed Oct 24 13:06:10.526162 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Is-Admin-Project: True Oct 24 13:06:10.526162 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 13:06:10.526162 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Project-Domain-Id: default Oct 24 13:06:10.526162 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Project-Domain-Name: Default Oct 24 13:06:10.526162 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Project-Id: f3929898cf764cd6a05e8662e83d95e0 Oct 24 13:06:10.526162 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Project-Name: admin Oct 24 13:06:10.526162 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Role: member,admin,reader Oct 24 13:06:10.526162 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Roles: member,admin,reader Oct 24 13:06:10.527698 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:06:10.527698 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Tenant: admin Oct 24 13:06:10.527698 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Tenant-Id: f3929898cf764cd6a05e8662e83d95e0 Oct 24 13:06:10.527698 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Tenant-Name: admin Oct 24 13:06:10.527698 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-User: admin Oct 24 13:06:10.527698 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-User-Domain-Id: default Oct 24 13:06:10.527698 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-User-Domain-Name: Default Oct 24 13:06:10.527698 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-User-Id: c47c715f72104fe1bd8f50179af11065 Oct 24 13:06:10.527698 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-User-Name: admin Oct 24 13:06:10.527698 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: method: > Oct 24 13:06:10.527698 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: exception: Flavor 42 could not be found. Oct 24 13:06:10.527698 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: action_args: {'id': '42'} Oct 24 13:06:10.527698 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:06:10.527698 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:06:10.528536 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 13:06:10.528536 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 13:06:10.528536 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 13:06:10.528536 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 13:06:10.528536 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 13:06:10.528536 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 13:06:10.528536 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 13:06:10.528536 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 13:06:10.528536 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 13:06:10.528536 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:06:10.528536 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 13:06:10.528536 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 13:06:10.528536 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 24 13:06:10.528536 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Oct 24 13:06:10.528536 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:06:10.528536 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Oct 24 13:06:10.528536 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:06:10.528536 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:06:10.528536 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:06:10.530432 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:06:10.530432 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:06:10.530432 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:06:10.530432 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:06:10.530432 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 13:06:10.530432 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:06:10.530432 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 24 13:06:10.530432 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Oct 24 13:06:10.530432 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:06:10.530432 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Oct 24 13:06:10.530432 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:06:10.530432 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:06:10.530432 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:06:10.530432 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:06:10.530432 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:06:10.530432 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 24 13:06:10.530432 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Oct 24 13:06:10.530432 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-af798dd3-e629-48b1-b8c7-d23229188b9b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:06:10.531768 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-af798dd3-e629-48b1-b8c7-d23229188b9b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.396766 Oct 24 13:06:10.531768 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Oct 24 13:06:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:10.538205 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-a19d5778-6964-4f3d-aed9-c4b1d58bac93 admin admin] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:06:10.559923 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-a19d5778-6964-4f3d-aed9-c4b1d58bac93 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025641 Oct 24 13:06:10.560461 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Oct 24 13:06:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:06:10.570808 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-60025004-00d7-4200-93f7-ccaf4e6d149d admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:06:10.593372 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-60025004-00d7-4200-93f7-ccaf4e6d149d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027056 Oct 24 13:06:10.593900 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Oct 24 13:06:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:06:10.603311 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-dd715b5f-c0d1-46b3-8a2c-620995020ab6 admin admin] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:06:10.608693 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.wsgi [None req-dd715b5f-c0d1-46b3-8a2c-620995020ab6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 24 13:06:10.611969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-dd715b5f-c0d1-46b3-8a2c-620995020ab6 admin admin] Request method failure captured: Oct 24 13:06:10.611969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 24 13:06:10.611969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: Accept: application/json Oct 24 13:06:10.611969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: Accept-Encoding: gzip, deflate Oct 24 13:06:10.611969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: Connection: keep-alive Oct 24 13:06:10.611969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: Content-Length: 0 Oct 24 13:06:10.611969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: Host: 10.222.0.42 Oct 24 13:06:10.611969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: Openstack-Api-Version: compute 2.92 Oct 24 13:06:10.611969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: Openstack-System-Scope: None Oct 24 13:06:10.611969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: User-Agent: python-novaclient Oct 24 13:06:10.611969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Auth-Token: gAAAAABjVo3BLs0tNrXdMm7KNtYp7ZYXGrHWHylhYMuBC908lGn0JLf8s1apGS18ZKwt5P521Wwkl6tNAF-qOtUvvKZSDIBT1BaankGNGako2R4RtqFg_7jI3wJOV72o5saEK-0iJfgDh_k0YgDROvSasUQUpeu7pYL0b_ZOnJSU4Gl0o_kNeAU Oct 24 13:06:10.611969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Domain-Id: None Oct 24 13:06:10.611969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Domain-Name: None Oct 24 13:06:10.611969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Identity-Status: Confirmed Oct 24 13:06:10.611969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Is-Admin-Project: True Oct 24 13:06:10.611969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 13:06:10.611969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Project-Domain-Id: default Oct 24 13:06:10.611969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Project-Domain-Name: Default Oct 24 13:06:10.611969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Project-Id: f3929898cf764cd6a05e8662e83d95e0 Oct 24 13:06:10.611969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Project-Name: admin Oct 24 13:06:10.611969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Role: member,admin,reader Oct 24 13:06:10.611969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Roles: member,admin,reader Oct 24 13:06:10.613479 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:06:10.613479 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Tenant: admin Oct 24 13:06:10.613479 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Tenant-Id: f3929898cf764cd6a05e8662e83d95e0 Oct 24 13:06:10.613479 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Tenant-Name: admin Oct 24 13:06:10.613479 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-User: admin Oct 24 13:06:10.613479 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-User-Domain-Id: default Oct 24 13:06:10.613479 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-User-Domain-Name: Default Oct 24 13:06:10.613479 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-User-Id: c47c715f72104fe1bd8f50179af11065 Oct 24 13:06:10.613479 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-User-Name: admin Oct 24 13:06:10.613479 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: method: > Oct 24 13:06:10.613479 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: exception: Flavor 42 could not be found. Oct 24 13:06:10.613479 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: action_args: {'id': '42'} Oct 24 13:06:10.613479 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:06:10.613479 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:06:10.614436 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 13:06:10.614436 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 13:06:10.614436 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 13:06:10.614436 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 13:06:10.614436 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 13:06:10.614436 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 13:06:10.614436 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 13:06:10.614436 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 13:06:10.614436 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 13:06:10.614436 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:06:10.614436 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 13:06:10.614436 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 13:06:10.614436 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 24 13:06:10.614436 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Oct 24 13:06:10.614436 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:06:10.614436 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Oct 24 13:06:10.614436 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:06:10.614436 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:06:10.614436 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:06:10.615889 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:06:10.615889 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:06:10.615889 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:06:10.615889 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:06:10.615889 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 13:06:10.615889 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:06:10.615889 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 24 13:06:10.615889 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Oct 24 13:06:10.615889 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:06:10.615889 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Oct 24 13:06:10.615889 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:06:10.615889 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:06:10.615889 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:06:10.615889 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:06:10.615889 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:06:10.615889 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 24 13:06:10.615889 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Oct 24 13:06:10.615889 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-dd715b5f-c0d1-46b3-8a2c-620995020ab6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:06:10.617111 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-dd715b5f-c0d1-46b3-8a2c-620995020ab6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013623 Oct 24 13:06:10.617111 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Oct 24 13:06:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 24 13:06:11.820564 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-60025004-00d7-4200-93f7-ccaf4e6d149d admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:06:11.821566 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-60025004-00d7-4200-93f7-ccaf4e6d149d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 24 13:06:11.821955 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 24 13:06:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:06:12.352266 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-206663dc-716a-42bd-8270-49501e8eaa91 admin admin] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:06:12.358517 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.wsgi [None req-206663dc-716a-42bd-8270-49501e8eaa91 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 24 13:06:12.360047 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-206663dc-716a-42bd-8270-49501e8eaa91 admin admin] Request method failure captured: Oct 24 13:06:12.360047 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 24 13:06:12.360047 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: Accept: application/json Oct 24 13:06:12.360047 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: Accept-Encoding: gzip, deflate Oct 24 13:06:12.360047 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: Connection: keep-alive Oct 24 13:06:12.360047 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: Content-Length: 0 Oct 24 13:06:12.360047 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: Host: 10.222.0.42 Oct 24 13:06:12.360047 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: Openstack-Api-Version: compute 2.92 Oct 24 13:06:12.360047 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: Openstack-System-Scope: None Oct 24 13:06:12.360047 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: User-Agent: python-novaclient Oct 24 13:06:12.360047 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Auth-Token: gAAAAABjVo3DG1-LGk1OZiLM-lXqV6WeDyV98yTl4uenEzY9idKFVj834htLykADhX66Rvbkw-z_r2eRt3a9rSX87eKMFnhtkhSFMWNLNnUwK2JmwQgA6gBgiUZHcvCC1CWIy5aKFQEFOaezrnNa82G6ymiR3leob19gXYYQqCrWYDyHBmeco_A Oct 24 13:06:12.360047 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Domain-Id: None Oct 24 13:06:12.360047 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Domain-Name: None Oct 24 13:06:12.360047 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Identity-Status: Confirmed Oct 24 13:06:12.360047 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Is-Admin-Project: True Oct 24 13:06:12.360047 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 13:06:12.360047 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Project-Domain-Id: default Oct 24 13:06:12.360047 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Project-Domain-Name: Default Oct 24 13:06:12.360047 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Project-Id: f3929898cf764cd6a05e8662e83d95e0 Oct 24 13:06:12.360047 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Project-Name: admin Oct 24 13:06:12.360047 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Role: member,admin,reader Oct 24 13:06:12.360047 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Roles: member,admin,reader Oct 24 13:06:12.361527 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:06:12.361527 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Tenant: admin Oct 24 13:06:12.361527 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Tenant-Id: f3929898cf764cd6a05e8662e83d95e0 Oct 24 13:06:12.361527 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Tenant-Name: admin Oct 24 13:06:12.361527 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-User: admin Oct 24 13:06:12.361527 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-User-Domain-Id: default Oct 24 13:06:12.361527 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-User-Domain-Name: Default Oct 24 13:06:12.361527 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-User-Id: c47c715f72104fe1bd8f50179af11065 Oct 24 13:06:12.361527 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-User-Name: admin Oct 24 13:06:12.361527 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: method: > Oct 24 13:06:12.361527 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: exception: Flavor 84 could not be found. Oct 24 13:06:12.361527 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: action_args: {'id': '84'} Oct 24 13:06:12.361527 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:06:12.361527 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:06:12.362366 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 13:06:12.362366 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 13:06:12.362366 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 13:06:12.362366 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 13:06:12.362366 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 13:06:12.362366 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 13:06:12.362366 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 13:06:12.362366 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 13:06:12.362366 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 13:06:12.362366 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:06:12.362366 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 13:06:12.362366 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 13:06:12.362366 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 24 13:06:12.362366 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Oct 24 13:06:12.362366 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:06:12.362366 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Oct 24 13:06:12.362366 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:06:12.362366 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:06:12.362366 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:06:12.363572 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:06:12.363572 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:06:12.363572 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:06:12.363572 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:06:12.363572 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 13:06:12.363572 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:06:12.363572 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 24 13:06:12.363572 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Oct 24 13:06:12.363572 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:06:12.363572 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Oct 24 13:06:12.363572 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:06:12.363572 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:06:12.363572 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:06:12.363572 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:06:12.363572 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:06:12.363572 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 24 13:06:12.363572 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Oct 24 13:06:12.363572 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-206663dc-716a-42bd-8270-49501e8eaa91 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:06:12.364738 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-206663dc-716a-42bd-8270-49501e8eaa91 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.396716 Oct 24 13:06:12.364738 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Oct 24 13:06:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:12.371030 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-e62b005a-92d2-414c-862a-e354faeb66e3 admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:06:12.386589 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-e62b005a-92d2-414c-862a-e354faeb66e3 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019192 Oct 24 13:06:12.387151 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Oct 24 13:06:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:06:12.396914 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-12a2b8e8-6517-4853-be70-c2d3f54e3654 admin admin] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:06:12.412619 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-12a2b8e8-6517-4853-be70-c2d3f54e3654 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019237 Oct 24 13:06:12.413143 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Oct 24 13:06:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:06:12.422766 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-05f4046f-d051-4bfc-9746-ec3030e6690f admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:06:12.427772 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.wsgi [None req-05f4046f-d051-4bfc-9746-ec3030e6690f admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 24 13:06:12.429260 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-05f4046f-d051-4bfc-9746-ec3030e6690f admin admin] Request method failure captured: Oct 24 13:06:12.429260 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 24 13:06:12.429260 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: Accept: application/json Oct 24 13:06:12.429260 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: Accept-Encoding: gzip, deflate Oct 24 13:06:12.429260 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: Connection: keep-alive Oct 24 13:06:12.429260 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: Content-Length: 0 Oct 24 13:06:12.429260 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: Host: 10.222.0.42 Oct 24 13:06:12.429260 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: Openstack-Api-Version: compute 2.92 Oct 24 13:06:12.429260 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: Openstack-System-Scope: None Oct 24 13:06:12.429260 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: User-Agent: python-novaclient Oct 24 13:06:12.429260 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Auth-Token: gAAAAABjVo3DG1-LGk1OZiLM-lXqV6WeDyV98yTl4uenEzY9idKFVj834htLykADhX66Rvbkw-z_r2eRt3a9rSX87eKMFnhtkhSFMWNLNnUwK2JmwQgA6gBgiUZHcvCC1CWIy5aKFQEFOaezrnNa82G6ymiR3leob19gXYYQqCrWYDyHBmeco_A Oct 24 13:06:12.429260 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Domain-Id: None Oct 24 13:06:12.429260 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Domain-Name: None Oct 24 13:06:12.429260 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Identity-Status: Confirmed Oct 24 13:06:12.429260 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Is-Admin-Project: True Oct 24 13:06:12.429260 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 13:06:12.429260 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Project-Domain-Id: default Oct 24 13:06:12.429260 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Project-Domain-Name: Default Oct 24 13:06:12.429260 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Project-Id: f3929898cf764cd6a05e8662e83d95e0 Oct 24 13:06:12.429260 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Project-Name: admin Oct 24 13:06:12.429260 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Role: member,admin,reader Oct 24 13:06:12.429260 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Roles: member,admin,reader Oct 24 13:06:12.430725 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:06:12.430725 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Tenant: admin Oct 24 13:06:12.430725 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Tenant-Id: f3929898cf764cd6a05e8662e83d95e0 Oct 24 13:06:12.430725 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Tenant-Name: admin Oct 24 13:06:12.430725 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-User: admin Oct 24 13:06:12.430725 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-User-Domain-Id: default Oct 24 13:06:12.430725 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-User-Domain-Name: Default Oct 24 13:06:12.430725 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-User-Id: c47c715f72104fe1bd8f50179af11065 Oct 24 13:06:12.430725 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-User-Name: admin Oct 24 13:06:12.430725 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: method: > Oct 24 13:06:12.430725 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: exception: Flavor 84 could not be found. Oct 24 13:06:12.430725 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: action_args: {'id': '84'} Oct 24 13:06:12.430725 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:06:12.430725 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:06:12.431741 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 13:06:12.431741 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 13:06:12.431741 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 13:06:12.431741 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 13:06:12.431741 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 13:06:12.431741 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 13:06:12.431741 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 13:06:12.431741 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 13:06:12.431741 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 13:06:12.431741 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:06:12.431741 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 13:06:12.431741 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 13:06:12.431741 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 24 13:06:12.431741 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Oct 24 13:06:12.431741 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:06:12.431741 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Oct 24 13:06:12.431741 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:06:12.431741 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:06:12.431741 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:06:12.433072 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:06:12.433072 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:06:12.433072 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:06:12.433072 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:06:12.433072 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 13:06:12.433072 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:06:12.433072 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 24 13:06:12.433072 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Oct 24 13:06:12.433072 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:06:12.433072 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Oct 24 13:06:12.433072 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:06:12.433072 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:06:12.433072 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:06:12.433072 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:06:12.433072 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:06:12.433072 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 24 13:06:12.433072 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Oct 24 13:06:12.433072 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-05f4046f-d051-4bfc-9746-ec3030e6690f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:06:12.434273 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-05f4046f-d051-4bfc-9746-ec3030e6690f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011929 Oct 24 13:06:12.434273 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Oct 24 13:06:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:13.636176 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-12a2b8e8-6517-4853-be70-c2d3f54e3654 admin admin] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:06:13.637173 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-12a2b8e8-6517-4853-be70-c2d3f54e3654 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 24 13:06:13.637563 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 24 13:06:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:06:14.165101 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-e3f044d3-8343-4915-ac25-76caa9e57ec1 admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:06:14.170908 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.wsgi [None req-e3f044d3-8343-4915-ac25-76caa9e57ec1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 24 13:06:14.172388 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-e3f044d3-8343-4915-ac25-76caa9e57ec1 admin admin] Request method failure captured: Oct 24 13:06:14.172388 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 24 13:06:14.172388 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: Accept: application/json Oct 24 13:06:14.172388 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: Accept-Encoding: gzip, deflate Oct 24 13:06:14.172388 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: Connection: keep-alive Oct 24 13:06:14.172388 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: Content-Length: 0 Oct 24 13:06:14.172388 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: Host: 10.222.0.42 Oct 24 13:06:14.172388 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: Openstack-Api-Version: compute 2.92 Oct 24 13:06:14.172388 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: Openstack-System-Scope: None Oct 24 13:06:14.172388 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: User-Agent: python-novaclient Oct 24 13:06:14.172388 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Auth-Token: gAAAAABjVo3F6dppUkWQtE6l6RBnCmdfgOZYUokWTKYo8ON95N3YDYIp4cHrUTVjRU95xd8vu8XDjR_uwOEmYA0NHW0nYOu-e7D39huP4TSYN6CL3r9MxNrVdLXhY0e8QQ0S4S8hsFkSp6z-i3ea-WE48jm7_2BJM3USZ0pdKABcxCuWAppRCSI Oct 24 13:06:14.172388 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Domain-Id: None Oct 24 13:06:14.172388 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Domain-Name: None Oct 24 13:06:14.172388 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Identity-Status: Confirmed Oct 24 13:06:14.172388 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Is-Admin-Project: True Oct 24 13:06:14.172388 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 13:06:14.172388 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Project-Domain-Id: default Oct 24 13:06:14.172388 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Project-Domain-Name: Default Oct 24 13:06:14.172388 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Project-Id: f3929898cf764cd6a05e8662e83d95e0 Oct 24 13:06:14.172388 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Project-Name: admin Oct 24 13:06:14.172388 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Role: member,admin,reader Oct 24 13:06:14.172388 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Roles: member,admin,reader Oct 24 13:06:14.173966 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:06:14.173966 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Tenant: admin Oct 24 13:06:14.173966 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Tenant-Id: f3929898cf764cd6a05e8662e83d95e0 Oct 24 13:06:14.173966 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-Tenant-Name: admin Oct 24 13:06:14.173966 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-User: admin Oct 24 13:06:14.173966 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-User-Domain-Id: default Oct 24 13:06:14.173966 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-User-Domain-Name: Default Oct 24 13:06:14.173966 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-User-Id: c47c715f72104fe1bd8f50179af11065 Oct 24 13:06:14.173966 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: X-User-Name: admin Oct 24 13:06:14.173966 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: method: > Oct 24 13:06:14.173966 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: exception: Flavor 451 could not be found. Oct 24 13:06:14.173966 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: action_args: {'id': '451'} Oct 24 13:06:14.173966 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:06:14.173966 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:06:14.175003 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 13:06:14.175003 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 13:06:14.175003 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 13:06:14.175003 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 13:06:14.175003 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 13:06:14.175003 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 13:06:14.175003 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 13:06:14.175003 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 13:06:14.175003 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 13:06:14.175003 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:06:14.175003 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 13:06:14.175003 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 13:06:14.175003 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 24 13:06:14.175003 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Oct 24 13:06:14.175003 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:06:14.175003 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Oct 24 13:06:14.175003 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:06:14.175003 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:06:14.175003 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:06:14.176434 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:06:14.176434 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:06:14.176434 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:06:14.176434 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:06:14.176434 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 13:06:14.176434 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:06:14.176434 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 24 13:06:14.176434 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Oct 24 13:06:14.176434 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:06:14.176434 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Oct 24 13:06:14.176434 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:06:14.176434 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:06:14.176434 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:06:14.176434 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:06:14.176434 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:06:14.176434 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 24 13:06:14.176434 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: ERROR nova.api.openstack.wsgi Oct 24 13:06:14.176434 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-e3f044d3-8343-4915-ac25-76caa9e57ec1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103887) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:06:14.177670 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-e3f044d3-8343-4915-ac25-76caa9e57ec1 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.398633 Oct 24 13:06:14.177913 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Oct 24 13:06:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:14.183071 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-cb88b2cf-f7ef-4c15-afe2-35cbb262b5c8 admin admin] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:06:14.198588 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-cb88b2cf-f7ef-4c15-afe2-35cbb262b5c8 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019004 Oct 24 13:06:14.199130 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Oct 24 13:06:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:06:14.209153 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-588be356-dfc6-4305-a63f-0af9805d78d1 admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:06:14.224116 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-588be356-dfc6-4305-a63f-0af9805d78d1 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018497 Oct 24 13:06:14.224650 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Oct 24 13:06:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:06:14.234267 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-c93bf0f5-12a5-4b91-8292-da4cda666c15 admin admin] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:06:14.239184 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.wsgi [None req-c93bf0f5-12a5-4b91-8292-da4cda666c15 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 24 13:06:14.240669 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-c93bf0f5-12a5-4b91-8292-da4cda666c15 admin admin] Request method failure captured: Oct 24 13:06:14.240669 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 24 13:06:14.240669 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: Accept: application/json Oct 24 13:06:14.240669 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: Accept-Encoding: gzip, deflate Oct 24 13:06:14.240669 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: Connection: keep-alive Oct 24 13:06:14.240669 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: Content-Length: 0 Oct 24 13:06:14.240669 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: Host: 10.222.0.42 Oct 24 13:06:14.240669 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: Openstack-Api-Version: compute 2.92 Oct 24 13:06:14.240669 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: Openstack-System-Scope: None Oct 24 13:06:14.240669 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: User-Agent: python-novaclient Oct 24 13:06:14.240669 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Auth-Token: gAAAAABjVo3F6dppUkWQtE6l6RBnCmdfgOZYUokWTKYo8ON95N3YDYIp4cHrUTVjRU95xd8vu8XDjR_uwOEmYA0NHW0nYOu-e7D39huP4TSYN6CL3r9MxNrVdLXhY0e8QQ0S4S8hsFkSp6z-i3ea-WE48jm7_2BJM3USZ0pdKABcxCuWAppRCSI Oct 24 13:06:14.240669 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Domain-Id: None Oct 24 13:06:14.240669 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Domain-Name: None Oct 24 13:06:14.240669 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Identity-Status: Confirmed Oct 24 13:06:14.240669 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Is-Admin-Project: True Oct 24 13:06:14.240669 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Openstack-Nova-Api-Version: 2.92 Oct 24 13:06:14.240669 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Project-Domain-Id: default Oct 24 13:06:14.240669 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Project-Domain-Name: Default Oct 24 13:06:14.240669 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Project-Id: f3929898cf764cd6a05e8662e83d95e0 Oct 24 13:06:14.240669 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Project-Name: admin Oct 24 13:06:14.240669 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Role: member,admin,reader Oct 24 13:06:14.240669 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Roles: member,admin,reader Oct 24 13:06:14.242198 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f3929898cf764cd6a05e8662e83d95e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:06:14.242198 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Tenant: admin Oct 24 13:06:14.242198 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Tenant-Id: f3929898cf764cd6a05e8662e83d95e0 Oct 24 13:06:14.242198 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-Tenant-Name: admin Oct 24 13:06:14.242198 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-User: admin Oct 24 13:06:14.242198 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-User-Domain-Id: default Oct 24 13:06:14.242198 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-User-Domain-Name: Default Oct 24 13:06:14.242198 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-User-Id: c47c715f72104fe1bd8f50179af11065 Oct 24 13:06:14.242198 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: X-User-Name: admin Oct 24 13:06:14.242198 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: method: > Oct 24 13:06:14.242198 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: exception: Flavor 451 could not be found. Oct 24 13:06:14.242198 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: action_args: {'id': '451'} Oct 24 13:06:14.242198 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:06:14.242198 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:06:14.243328 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 24 13:06:14.243328 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 24 13:06:14.243328 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 24 13:06:14.243328 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 24 13:06:14.243328 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 13:06:14.243328 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 13:06:14.243328 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 24 13:06:14.243328 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 24 13:06:14.243328 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 24 13:06:14.243328 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:06:14.243328 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 24 13:06:14.243328 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 24 13:06:14.243328 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 24 13:06:14.243328 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Oct 24 13:06:14.243328 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:06:14.243328 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Oct 24 13:06:14.243328 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:06:14.243328 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:06:14.243328 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:06:14.244613 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:06:14.244613 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:06:14.244613 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:06:14.244613 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:06:14.244613 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 24 13:06:14.244613 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:06:14.244613 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 24 13:06:14.244613 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Oct 24 13:06:14.244613 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:06:14.244613 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Oct 24 13:06:14.244613 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:06:14.244613 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:06:14.244613 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:06:14.244613 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:06:14.244613 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:06:14.244613 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 24 13:06:14.244613 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: ERROR nova.api.openstack.wsgi Oct 24 13:06:14.244613 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-c93bf0f5-12a5-4b91-8292-da4cda666c15 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103886) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:06:14.245923 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-c93bf0f5-12a5-4b91-8292-da4cda666c15 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011707 Oct 24 13:06:14.245923 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Oct 24 13:06:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 24 13:06:15.453365 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-588be356-dfc6-4305-a63f-0af9805d78d1 admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:06:15.454379 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-588be356-dfc6-4305-a63f-0af9805d78d1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 24 13:06:15.454778 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 24 13:06:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:06:15.975670 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-8c03af7b-2874-4348-842b-0c691cf2fbd9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:06:15.994969 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-8c03af7b-2874-4348-842b-0c691cf2fbd9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.401453 Oct 24 13:06:15.995538 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Oct 24 13:06:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:06:17.208600 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-588be356-dfc6-4305-a63f-0af9805d78d1 admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:06:17.209661 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-588be356-dfc6-4305-a63f-0af9805d78d1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Oct 24 13:06:17.210053 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 24 13:06:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:06:17.739028 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-38bae841-8c39-4357-9f25-3a7e57379a32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:06:17.758441 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-38bae841-8c39-4357-9f25-3a7e57379a32 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.405081 Oct 24 13:06:17.759043 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Oct 24 13:06:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:06:18.956676 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-588be356-dfc6-4305-a63f-0af9805d78d1 admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:06:18.957688 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-588be356-dfc6-4305-a63f-0af9805d78d1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Oct 24 13:06:18.958087 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 24 13:06:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:06:19.485885 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-78c99b93-cb5a-4827-a05a-0cc2a39f61ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:06:19.505024 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-78c99b93-cb5a-4827-a05a-0cc2a39f61ba admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.408931 Oct 24 13:06:19.505549 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Oct 24 13:06:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:06:20.723858 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-588be356-dfc6-4305-a63f-0af9805d78d1 admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:06:20.724854 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-588be356-dfc6-4305-a63f-0af9805d78d1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 24 13:06:20.725239 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 24 13:06:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:06:21.257645 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-40987b62-76ba-405c-9ec8-aecea9f700eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:06:21.277241 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-40987b62-76ba-405c-9ec8-aecea9f700eb admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.410638 Oct 24 13:06:21.277773 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Oct 24 13:06:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:06:22.500802 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-588be356-dfc6-4305-a63f-0af9805d78d1 admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:06:22.501817 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-588be356-dfc6-4305-a63f-0af9805d78d1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 24 13:06:22.502233 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 24 13:06:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:06:23.024232 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-c533e5a3-3d34-4f2f-ae09-a49e5834ee86 admin admin] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:06:23.044328 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-c533e5a3-3d34-4f2f-ae09-a49e5834ee86 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.400489 Oct 24 13:06:23.044861 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Mon Oct 24 13:06:22 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:07:20.036514 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-588be356-dfc6-4305-a63f-0af9805d78d1 admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:07:20.037559 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-588be356-dfc6-4305-a63f-0af9805d78d1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 24 13:07:20.037950 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 931 bytes} [Mon Oct 24 13:07:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:07:20.048441 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG dbcounter [-] [103886] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:20.445808 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-9aef7d84-b73b-4b12-a1e3-088a82878311 admin admin] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:07:20.465970 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-9aef7d84-b73b-4b12-a1e3-088a82878311 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.422049 Oct 24 13:07:20.466498 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1292 bytes} [Mon Oct 24 13:07:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:07:20.488644 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG dbcounter [-] [103887] Writing DB stats nova_api:SELECT=14 {{(pid=103887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:07:20.492496 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-c5ba0632-795f-47bb-ac73-a6138992cff8 admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:07:20.500556 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-c5ba0632-795f-47bb-ac73-a6138992cff8 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013333 Oct 24 13:07:20.501071 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1283 bytes} [Mon Oct 24 13:07:20 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:07:20.512889 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-0eb8bffb-b76a-4403-9901-34e95135baa9 admin admin] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:07:20.520148 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-0eb8bffb-b76a-4403-9901-34e95135baa9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010895 Oct 24 13:07:20.520666 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1286 bytes} [Mon Oct 24 13:07:20 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:07:20.532092 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-e8a280f8-dfba-4662-b592-7f6534b1b852 admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:07:20.539295 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-e8a280f8-dfba-4662-b592-7f6534b1b852 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010632 Oct 24 13:07:20.539755 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1286 bytes} [Mon Oct 24 13:07:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:07:20.551649 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-498132d0-0cd9-42cb-9f28-18626f9de53d admin admin] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:07:20.558639 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-498132d0-0cd9-42cb-9f28-18626f9de53d admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010551 Oct 24 13:07:20.559176 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1283 bytes} [Mon Oct 24 13:07:20 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:10:20.643249 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-e8a280f8-dfba-4662-b592-7f6534b1b852 admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:10:20.644269 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-e8a280f8-dfba-4662-b592-7f6534b1b852 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Oct 24 13:10:20.644670 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 24 13:10:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:10:20.788128 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG dbcounter [-] [103886] Writing DB stats nova_api:SELECT=6 {{(pid=103886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:10:20.953348 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-dd1b2a32-8992-4202-ba63-c6c8e3296409 admin admin] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:10:20.958254 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-dd1b2a32-8992-4202-ba63-c6c8e3296409 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:10:20.958747 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-dd1b2a32-8992-4202-ba63-c6c8e3296409 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:10:20.959206 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-dd1b2a32-8992-4202-ba63-c6c8e3296409 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:10:20.959906 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-dd1b2a32-8992-4202-ba63-c6c8e3296409 admin admin] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:10:20.960340 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-dd1b2a32-8992-4202-ba63-c6c8e3296409 admin admin] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:10:20.960749 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-dd1b2a32-8992-4202-ba63-c6c8e3296409 admin admin] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:10:20.992470 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-dd1b2a32-8992-4202-ba63-c6c8e3296409 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.205505 Oct 24 13:10:20.993010 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Oct 24 13:10:20 2022] GET /compute/v2.1/os-services => generated 791 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:10:22.078383 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-e8a280f8-dfba-4662-b592-7f6534b1b852 admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:10:22.078383 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-e8a280f8-dfba-4662-b592-7f6534b1b852 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Oct 24 13:10:22.079008 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 24 13:10:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:10:22.269291 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-9c81a125-3e7e-4ca7-ad71-73ef1151fdf9 admin admin] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:10:22.272668 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-9c81a125-3e7e-4ca7-ad71-73ef1151fdf9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:10:22.273135 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-9c81a125-3e7e-4ca7-ad71-73ef1151fdf9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:10:22.273553 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-9c81a125-3e7e-4ca7-ad71-73ef1151fdf9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:10:22.274280 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-9c81a125-3e7e-4ca7-ad71-73ef1151fdf9 admin admin] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:10:22.274715 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-9c81a125-3e7e-4ca7-ad71-73ef1151fdf9 admin admin] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:10:22.275150 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-9c81a125-3e7e-4ca7-ad71-73ef1151fdf9 admin admin] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:10:22.294793 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-9c81a125-3e7e-4ca7-ad71-73ef1151fdf9 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.076114 Oct 24 13:10:22.295298 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Oct 24 13:10:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:10:33.761215 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-e8a280f8-dfba-4662-b592-7f6534b1b852 admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:10:33.762213 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-e8a280f8-dfba-4662-b592-7f6534b1b852 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Oct 24 13:10:33.762664 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 24 13:10:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:10:33.905185 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG dbcounter [-] [103886] Writing DB stats nova_cell0:SELECT=4 {{(pid=103886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:10:33.906298 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG dbcounter [-] [103886] Writing DB stats nova_cell1:SELECT=4 {{(pid=103886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:10:33.906978 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG dbcounter [-] [103886] Writing DB stats nova_api:SELECT=8 {{(pid=103886) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:10:33.955098 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-3a1fd324-1999-44b4-9fd8-890f28b29ebe admin admin] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:10:33.958506 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-3a1fd324-1999-44b4-9fd8-890f28b29ebe admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:10:33.959001 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-3a1fd324-1999-44b4-9fd8-890f28b29ebe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:10:33.959443 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-3a1fd324-1999-44b4-9fd8-890f28b29ebe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:10:33.960144 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-3a1fd324-1999-44b4-9fd8-890f28b29ebe admin admin] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:10:33.960580 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-3a1fd324-1999-44b4-9fd8-890f28b29ebe admin admin] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:10:33.960986 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-3a1fd324-1999-44b4-9fd8-890f28b29ebe admin admin] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:10:33.986401 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-3a1fd324-1999-44b4-9fd8-890f28b29ebe admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.085712 Oct 24 13:10:33.986877 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Oct 24 13:10:33 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:10:35.058666 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG nova.api.openstack.wsgi [None req-e8a280f8-dfba-4662-b592-7f6534b1b852 admin admin] Calling method '>' {{(pid=103887) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:10:35.060476 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: INFO nova.api.openstack.requestlog [None req-e8a280f8-dfba-4662-b592-7f6534b1b852 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 24 13:10:35.060870 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: [pid: 103887|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Oct 24 13:10:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:10:35.252441 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG nova.api.openstack.wsgi [None req-a027b8fa-f431-4462-b023-2f9ec194ca24 admin admin] Calling method '>' {{(pid=103886) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:10:35.255787 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-a027b8fa-f431-4462-b023-2f9ec194ca24 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:10:35.256251 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-a027b8fa-f431-4462-b023-2f9ec194ca24 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:10:35.256731 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-a027b8fa-f431-4462-b023-2f9ec194ca24 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:10:35.257429 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-a027b8fa-f431-4462-b023-2f9ec194ca24 admin admin] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:10:35.257862 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-a027b8fa-f431-4462-b023-2f9ec194ca24 admin admin] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:10:35.258267 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: DEBUG oslo_concurrency.lockutils [None req-a027b8fa-f431-4462-b023-2f9ec194ca24 admin admin] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103886) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:10:35.280982 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: INFO nova.api.openstack.requestlog [None req-a027b8fa-f431-4462-b023-2f9ec194ca24 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.080679 Oct 24 13:10:35.281457 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: [pid: 103886|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Oct 24 13:10:35 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:11:32.815891 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: Mon Oct 24 13:11:32 2022 - graceful shutdown triggered... Oct 24 13:11:32.816432 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: Gracefully killing worker 2 (pid: 103887)... Oct 24 13:11:32.816017 dv-cinder-862489-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 24 13:11:32.817221 dv-cinder-862489-1-iscsi devstack@n-api.service[103886]: Gracefully killing worker 1 (pid: 103886)... Oct 24 13:11:32.942010 dv-cinder-862489-1-iscsi devstack@n-api.service[103887]: DEBUG dbcounter [-] [103887] Writing DB stats nova_api:SELECT=4 {{(pid=103887) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:11:33.816959 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: worker 1 buried after 1 seconds Oct 24 13:11:33.817529 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: worker 2 buried after 1 seconds Oct 24 13:11:33.817529 dv-cinder-862489-1-iscsi devstack@n-api.service[103885]: goodbye to uWSGI. Oct 24 13:11:33.818517 dv-cinder-862489-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 24 13:11:33.819091 dv-cinder-862489-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 24 13:11:33.821998 dv-cinder-862489-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 24 13:11:33.831216 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 24 13:11:33.833215 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 24 13:11:33 2022] *** Oct 24 13:11:33.833215 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 24 13:11:33.833215 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 24 13:11:33.833215 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: nodename: dv-cinder-862489-1-iscsi Oct 24 13:11:33.833215 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: machine: x86_64 Oct 24 13:11:33.833215 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: clock source: unix Oct 24 13:11:33.833215 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: pcre jit disabled Oct 24 13:11:33.833215 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: detected number of CPU cores: 4 Oct 24 13:11:33.833215 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: current working directory: / Oct 24 13:11:33.833215 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: detected binary path: /usr/bin/uwsgi-core Oct 24 13:11:33.833872 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: your processes number limit is 47680 Oct 24 13:11:33.833872 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: your memory page size is 4096 bytes Oct 24 13:11:33.833872 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: detected max file descriptor number: 2048 Oct 24 13:11:33.833872 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: lock engine: pthread robust mutexes Oct 24 13:11:33.833872 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: thunder lock: enabled Oct 24 13:11:33.833872 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 24 13:11:33.833872 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 24 13:11:33.874068 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: Python main interpreter initialized at 0x556dc5fc89c0 Oct 24 13:11:33.874068 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: python threads support enabled Oct 24 13:11:33.874068 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: your server socket listen backlog is limited to 100 connections Oct 24 13:11:33.874068 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: your mercy for graceful operations on workers is 90 seconds Oct 24 13:11:33.874530 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: mapped 403077 bytes (393 KB) for 2 cores Oct 24 13:11:33.874530 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: *** Operational MODE: preforking *** Oct 24 13:11:33.874798 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: *** uWSGI is running in multiple interpreter mode *** Oct 24 13:11:33.874798 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: spawned uWSGI master process (pid: 118901) Oct 24 13:11:33.875001 dv-cinder-862489-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 24 13:11:33.876173 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: spawned uWSGI worker 1 (pid: 118914, cores: 1) Oct 24 13:11:33.876711 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: spawned uWSGI worker 2 (pid: 118915, cores: 1) Oct 24 13:11:33.877018 dv-cinder-862489-1-iscsi devstack@n-api.service[118901]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 24 13:11:34.539696 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 13:11:34.540295 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 24 13:11:35.791298 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:11:35.791298 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: from cryptography.utils import int_from_bytes Oct 24 13:11:35.791914 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:11:35.791914 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: from cryptography.utils import int_from_bytes Oct 24 13:11:35.806882 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:11:35.806882 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: from cryptography.utils import int_from_bytes Oct 24 13:11:35.807514 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 13:11:35.807514 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: from cryptography.utils import int_from_bytes Oct 24 13:11:38.216999 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 13:11:38.217554 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 13:11:38.217785 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 13:11:38.218150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 13:11:38.218409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 13:11:38.218798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.219177 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.219502 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.219821 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.220154 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.220469 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.220787 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.221106 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.221435 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.221697 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.222014 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.222340 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862489-1-iscsi {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.222665 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.222973 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.223316 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.223636 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.223940 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.224265 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.224572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.225072 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.226167 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.226167 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.226167 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.226426 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.226736 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.227068 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.227405 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.227705 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.228031 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.228338 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.228735 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862489-1-iscsi {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.229054 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.229368 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.229684 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.230097 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.230482 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.230711 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.231621 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.231621 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.231935 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.232089 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.232310 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.232632 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.232956 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.233263 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.233572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.233882 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.234202 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.234510 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.234845 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.235272 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.235600 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.235927 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.236286 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.236695 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.236955 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.237209 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.237534 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.237857 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.238226 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.238478 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.238784 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.239113 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.239423 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.239738 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.240047 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.240354 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.240682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.240997 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.241322 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.241631 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.241954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.242355 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.242608 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.242919 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.243290 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.243615 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.243926 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.244413 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.244558 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.244895 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.245173 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.245510 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.245832 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.246169 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.246477 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.246728 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.247712 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.247712 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.247712 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.248178 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.248349 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.248557 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.248859 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.249166 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.249472 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.249780 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.250086 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.250919 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.251251 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.251559 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.251867 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.252173 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.252479 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.252799 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.253120 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.253428 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.253740 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.254047 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.254354 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.254676 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.255033 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.255308 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.255631 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.255938 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.256243 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.256564 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.256870 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.257176 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.257496 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.257797 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.258104 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.258423 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.258725 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.259032 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.259627 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.259936 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.260243 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.260547 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.260902 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.261152 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.261452 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.261771 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.262091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.262400 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.262556 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 13:11:38.263022 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.263210 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 13:11:38.263362 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.263362 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.263644 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 13:11:38.263801 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.263940 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 13:11:38.263940 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 13:11:38.264220 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.264367 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.264503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.264652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.264791 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.264948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.265117 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.265270 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.265416 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.265575 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.265715 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.265927 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.266642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.266791 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.266938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.267116 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.267282 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.267422 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.267568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.267707 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.267843 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.267989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.268148 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.268288 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862489-1-iscsi {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.268434 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.268580 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.268718 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.268879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.269110 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.269253 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.269399 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.269545 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.269684 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.269821 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.269972 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.270136 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.270275 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.270420 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.270557 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.270758 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.270911 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.271140 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.271298 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.271437 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.271574 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.271722 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.271882 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.272078 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.272234 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.272399 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.272559 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.272733 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.272885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.273062 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.273217 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.273379 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.273539 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.273687 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.273847 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.273994 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.274145 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.274337 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.274493 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862489-1-iscsi {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.274655 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.274813 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.274959 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.275189 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.275349 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.275489 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.275645 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.275900 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.276077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.276225 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.276380 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.276531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.276679 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.277900 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.278062 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.278224 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.278366 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.278507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.278654 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.279107 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.279272 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.279440 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.279583 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.279721 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.279860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.280005 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.280150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.280298 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.280455 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.280608 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.280754 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.280899 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.281045 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.281205 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.281352 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.281544 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.281698 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.281845 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.281999 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.282147 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.282286 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.282425 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.282562 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.282709 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.282862 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.282862 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.283165 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.283317 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.283456 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.283456 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.283739 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.283877 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.284017 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.284162 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.284308 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.284456 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.284603 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.284742 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.284900 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.285047 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.285192 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.285344 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.285482 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.285636 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.285776 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.285914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.286081 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.286229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.286368 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.286506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.286653 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.286799 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.286955 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.287128 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.287273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.287410 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.287548 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.287698 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.287845 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.287985 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.288122 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.288266 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.288404 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.288550 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.288702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.288841 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.288987 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.289133 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.289270 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.289407 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.289557 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.289696 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.289841 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.289987 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.290134 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.290281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.290428 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.290574 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.290719 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.290857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.290994 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.291174 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.291327 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.291467 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.291611 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.291757 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.291895 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.292040 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.292194 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.292341 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.292479 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.292616 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.292754 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.292891 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.293042 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.293182 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.293327 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.293477 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.293615 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.293760 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.293907 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.294062 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.294231 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.294375 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.294546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.294702 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.294856 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.294996 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.295155 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.295296 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.295444 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.295681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.295857 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.295998 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.296146 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.296285 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.296431 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.296578 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.296716 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.296853 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.296998 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.297136 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.297272 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.297419 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.297557 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.297695 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.297840 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.297987 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.298134 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.298286 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.298286 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.298556 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.298694 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.298839 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.298986 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.299146 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.299296 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.299443 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.299582 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.299719 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.299867 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.300013 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.300158 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.300305 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.300452 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.300599 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.300746 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.300883 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.301020 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.301170 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.301309 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.301459 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.301606 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.301764 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.301909 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.302063 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.302215 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.302360 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.302507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.302646 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.302785 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.302951 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.303130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.303288 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.303288 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.303574 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.303574 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.303855 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.304001 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.304140 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.304278 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.304424 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.304578 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.304719 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.304856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.304994 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.305133 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.305270 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.305468 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.305616 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.305756 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.305912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.306173 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.306340 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.306493 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.306633 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.306817 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.306970 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.307126 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.307293 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.307443 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.307600 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.307741 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 13:11:38.307880 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.307880 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.308155 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.308303 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.308450 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.308615 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.309351 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.309514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.309666 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.309813 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.309954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.310116 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.310256 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.310403 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.310552 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.310692 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.310831 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.310977 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.311179 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.311339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.311488 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.311635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.311781 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.311942 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.312083 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.312236 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.312386 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.312533 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.313185 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.313406 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.313555 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.313709 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.313909 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.314067 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.314216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.314355 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.314514 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.314663 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.314813 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.314954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.315111 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.315257 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.315415 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.315559 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.315706 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.315844 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.315844 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.316106 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.316254 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.316402 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.316541 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.316680 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.316818 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.316956 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.317103 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.317251 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.317391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.317529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.317675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.317821 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.317969 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.318115 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.318264 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.318404 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.318542 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.318688 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.318834 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.318981 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.319151 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.319294 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.319432 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.319590 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.319736 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.319882 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.320031 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.320177 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.320315 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.320467 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.320606 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.320753 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.320900 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.321046 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.321185 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.321332 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.321471 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.321609 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.321746 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.321950 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.322123 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.322274 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.322413 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.322552 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.322689 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.322835 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.322988 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.323214 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.323356 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.323501 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.323744 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.323902 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.324131 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.324274 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.324411 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.324550 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.324703 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.324843 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.324995 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.325142 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.325289 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.325438 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.325631 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.325791 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.325931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.326083 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.326229 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.326368 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.326506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.326657 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.326657 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.326964 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.327139 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.327293 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.327442 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.327591 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.327731 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.327882 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.328021 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.328167 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.328355 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.329009 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.329152 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.329289 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.329442 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.329589 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.329727 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.329867 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.330006 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.330159 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.330321 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.330469 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.330608 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.330747 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.330892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.331092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.331257 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.331397 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.331542 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.331681 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.331818 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.331957 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.332110 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.332259 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.332407 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.332553 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.332692 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.332843 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.332990 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.333139 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.333278 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.333423 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.333569 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.333722 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.333869 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.334025 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.334172 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.334312 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.334450 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.334598 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.334737 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.334875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.335023 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.335215 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.335362 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.335524 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.335672 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.335811 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.335960 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.336107 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.336261 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.336400 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.336538 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.336704 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.336852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.337002 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.337154 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.337303 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.337449 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.337596 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.337734 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.337883 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.338031 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.338195 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.338343 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.338509 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.338663 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.338811 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.338957 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.339157 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.339316 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.339464 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.339603 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.339786 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.339944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.340094 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.340241 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.340382 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.340527 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.340676 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.340815 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.340983 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.341130 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.341303 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.341450 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.341603 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.341763 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.341904 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.342048 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.342193 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.342347 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.342494 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.342634 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.342797 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.342951 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.343148 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.343306 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.343455 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.343596 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.343746 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.343913 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.344120 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.344445 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.344643 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.344786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.344924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.345062 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.345225 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.345383 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.345540 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.345689 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.345829 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.345978 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.346127 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.346274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.346444 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.346593 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.346777 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.346932 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.347148 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.347299 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.347448 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.347594 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.347742 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.347888 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.348057 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.348198 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.348337 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.348475 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.348642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.348799 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.348952 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.349100 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.349240 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.349379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.349539 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.349702 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.349851 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.350007 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.350147 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.350286 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.350460 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.350617 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.350781 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.350936 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.351108 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.351257 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.351431 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.351593 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.351733 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.351883 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.352030 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.352170 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.352330 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.352487 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.352634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.352773 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.352935 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.353083 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.353353 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.353514 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.353656 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.353795 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.353948 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.354097 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.354317 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.354468 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.354614 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.354760 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.354912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.355123 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.355296 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.355443 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.355607 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.355761 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.355908 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.356072 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.356229 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.356384 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.356529 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.356674 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.356826 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.356980 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.357128 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.357281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.357426 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.357579 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.357724 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.357882 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.358038 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.358193 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.358347 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.358499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.358651 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.358822 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.359655 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.359827 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.359976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.360133 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.360290 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.360446 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.360600 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.360758 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.360904 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.361057 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.361057 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.361345 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.361493 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.361646 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.361800 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.361953 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.362173 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.362329 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.362477 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.362631 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.362789 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.362943 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.363169 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.363333 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.363489 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.363643 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.363789 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.363942 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.364098 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.364244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.364389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.364543 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.364701 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.364847 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.365007 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.365154 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.365300 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.365451 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.365601 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.365760 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.365907 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.366052 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.366197 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.366342 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.366488 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.366654 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.366801 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.366946 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.367114 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.367814 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.367814 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.368167 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.368328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.368476 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.368476 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.368753 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.368906 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.369066 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.369066 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.369363 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.369509 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.369662 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.369818 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.369964 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.370109 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.370262 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.370408 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.370554 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.370554 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.370554 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.370996 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.371203 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.371361 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.371508 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.371662 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.371818 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.371967 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.371967 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.372242 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.372388 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.372543 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.372773 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.372996 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.373162 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.373317 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.373473 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.373618 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.373765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.373934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.374082 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.374228 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.374373 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.374527 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.374680 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.374835 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.374981 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.375690 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.375858 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.376016 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.376164 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.376324 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.376471 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.376616 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.376760 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.376906 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.377066 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.377212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.377365 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.377519 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.377683 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.377829 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.377987 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.378143 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.378297 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.378451 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.378451 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.378728 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.378900 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.379047 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.379220 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.379376 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.379543 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.379689 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.380108 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.380262 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.380416 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.380570 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.380715 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.380875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.381029 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.381175 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.381322 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.381476 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.381622 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.381791 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.381945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.382099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.382245 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.382391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.382537 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.382692 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.382839 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.382983 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.383174 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.383333 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.383489 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.383649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.383819 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.383975 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.384120 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.384538 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.384696 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.384850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.384997 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.385150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.385304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.385459 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.385619 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.385767 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.385938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.385938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.386222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.386368 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.386530 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.386684 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.386848 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.387293 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.387459 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.387616 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.387772 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.387927 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.388073 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.388237 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.388568 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.388735 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.388883 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.389030 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.389185 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.389332 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.389479 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.389637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.389792 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.389939 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.390085 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.390239 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.390397 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.390552 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.390700 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.390909 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.391624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.391775 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.391933 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.392094 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.392242 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.392388 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.392533 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.392680 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.392836 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.393197 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.393361 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.393509 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.393889 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.394053 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.394366 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.394523 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.394671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.394826 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.394974 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.395146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.395308 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.395459 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.395618 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.395787 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.395947 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.396103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.396260 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.396407 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.396561 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.396709 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.396855 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.397012 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.397158 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.397313 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.397478 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.397636 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.397798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.397955 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.398114 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.398269 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.398424 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.398578 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.398725 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.398879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.399026 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.399245 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.399393 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.399550 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.399696 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.399859 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.399859 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.400153 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.400311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.400457 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.400617 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.400764 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.400918 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.401073 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.401221 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.401366 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.401593 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.401755 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.401903 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.402050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.402204 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.402351 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.402507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.402662 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.403437 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.403600 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.403748 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.403915 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.404073 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.404232 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.404232 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.404512 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.404673 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.404829 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.405021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.405190 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.405345 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.405932 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.406224 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.406425 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.406584 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.406751 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.406945 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.407126 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.407288 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.407437 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.407584 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.407730 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.407884 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.408040 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.408194 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.408342 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.408487 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.408647 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.408805 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.408961 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.409108 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.409261 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.409409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.409565 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.409727 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.409888 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.410036 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.410181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.410181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.410459 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.410613 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.410785 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.410933 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.411129 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.411296 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.411452 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.411612 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.411760 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.411914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.411914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.412207 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.412362 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.412517 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.412664 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.412822 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.412982 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.413138 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.413284 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.413443 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.413590 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.413735 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.413891 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.414045 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.414200 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.414359 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.414507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.414664 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.414823 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.414970 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.415155 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.415315 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.415472 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.415626 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.415774 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.415940 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.416101 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.416249 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.416403 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.416403 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.416698 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.416910 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.417071 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.417227 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.417374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.417520 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.417667 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.417823 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.417972 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.417972 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.417972 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.418403 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.418550 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.418709 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.418857 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.419011 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.419198 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.419356 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.419511 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.419659 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.419804 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.419960 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.420109 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.420262 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.420427 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.420574 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.420728 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.420884 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.421030 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.421176 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.421330 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.421484 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.421632 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.421785 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.421949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.422210 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.422371 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.422533 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.422680 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.422880 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.423092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.423270 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.423432 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.423588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.423754 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.423988 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.424164 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.424330 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.424330 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.424628 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.424776 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.424922 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.425075 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.425231 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.425394 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.425556 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.425711 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.425873 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.426033 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.426181 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.426337 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.426484 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.426640 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.426796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.426951 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.427127 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.427127 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.427425 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.427572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.427718 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.427877 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.430361 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.430557 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.430725 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.430888 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.431148 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.431325 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.431478 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.431627 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.431783 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.431940 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.432103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.432259 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.432406 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.432406 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.432693 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.432841 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.433012 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.433169 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.433324 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.433480 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.433635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.433783 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.433983 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.434134 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.434280 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.434441 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.434588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.434742 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.434897 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.435983 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.436152 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.436301 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.436461 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.436622 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.436788 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.436938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.437083 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.437229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.437376 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.437531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.438217 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.438217 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.438541 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.438690 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.438837 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.439044 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.439278 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.439435 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.439591 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.439739 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.439893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.440051 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.440206 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.440360 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.440528 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.440675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.440831 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.440979 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.441126 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.441273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.441427 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.441582 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.441738 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.441885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.442031 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.442179 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.442325 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.442495 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.442715 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.442873 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.443028 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.443330 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.443484 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.443639 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.443801 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.443958 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.444105 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.444260 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.444434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.445177 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.445361 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.445521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.445669 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.445822 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.445974 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.445974 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.446276 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.446431 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.446431 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.446719 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.446870 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.446870 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.447223 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.447393 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.447541 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.447688 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.447688 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.447989 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.448146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.448301 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.448457 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.448457 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.448743 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.448898 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.449053 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.449219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.449219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.449505 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.449662 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.449809 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.449955 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.449955 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.450237 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.450393 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.450611 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.450761 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.450908 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.451070 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.451235 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.451394 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.451551 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.451698 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.451844 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.451990 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.452147 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.452308 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.452461 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.452617 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.452772 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.452920 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.453066 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.453237 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.453950 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.454199 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.454199 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.454659 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.454659 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.455028 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.455202 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.455350 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.455496 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.455643 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.455801 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.455985 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.456136 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.456283 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.456429 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.456576 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.456730 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.456887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.457042 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.457189 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.457342 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.457490 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.457649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.457799 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.457956 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.458104 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.458264 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.458412 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.458572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.458719 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.458866 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.459046 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.459256 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.459413 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.459566 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.459713 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.459860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.459860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.460158 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.460315 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.460461 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.460607 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.460752 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.460898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.461045 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.461199 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.461346 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.461492 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.461652 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.461816 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.461963 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.462123 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.462270 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.462426 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.462573 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.462719 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.462877 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.463032 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.463213 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.463379 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.463528 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.463684 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.463844 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.464010 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.464168 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.464315 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.464462 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.464616 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.464764 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.464764 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.464764 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.464764 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.465319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.465488 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.465639 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.465792 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.465957 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.466116 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.466271 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.466435 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.466435 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.466719 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.466866 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.467019 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.467230 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.467398 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.467546 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.467692 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.467846 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.467993 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.468151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.468501 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.468658 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.468815 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.469005 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.469157 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.469317 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.469466 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.469629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.469846 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.470014 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.470177 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.470177 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.470458 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.470612 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.470766 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.470921 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.471097 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.471263 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.471425 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.471573 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.471737 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.471891 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.472046 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.472193 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.472193 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.472487 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.472640 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.472795 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.472956 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.473104 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.473250 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.473396 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.473561 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.473725 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.473873 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.474018 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.474172 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.474327 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.474474 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.474635 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.474782 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.474782 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.475087 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.475240 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.475388 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.475555 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.475703 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.475856 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.476006 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.476153 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.476299 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.476459 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.476606 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.476761 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.476908 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.477054 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.477208 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.477355 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.477521 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.477668 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.477824 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.477979 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.478140 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.478287 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.478433 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.478579 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.478724 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.478871 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.479029 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.479249 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.479249 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.479539 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.479683 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.479845 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.480071 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.480230 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.480390 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.480537 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.480690 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.481111 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.481265 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.481412 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.481565 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.481731 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.481731 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.482018 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.482165 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.482311 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.482457 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.482603 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.482749 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.482907 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.483083 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.483248 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.483396 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.483552 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.483712 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.483872 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.484028 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.484174 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.484346 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.485057 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.485225 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.485463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.485642 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.485861 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.486013 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.486175 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.486357 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.486510 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.486666 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.486812 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.486958 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.487139 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.487294 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.487448 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.487596 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.487750 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.487896 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.488056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.488212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.488379 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.488526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.488672 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.488818 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.488973 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.489129 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.489285 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.489433 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.489586 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.489732 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.489887 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.490035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.490209 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.490938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.491151 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.491326 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.491485 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.491633 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.491793 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.491968 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.492252 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118915) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 13:11:38.492422 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.492422 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.492422 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.492422 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.492422 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.492422 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.492422 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.492422 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.493553 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.493553 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.493553 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.493553 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.493553 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.493553 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.493553 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.493553 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.494643 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.494643 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.494643 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.494643 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.494643 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.494643 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.494643 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.494643 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.495795 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.495795 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.495795 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.495795 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.495795 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.495795 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.495795 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.495795 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.496911 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.496911 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.496911 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.497326 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.497326 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.497609 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.497937 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.498276 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.498597 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.498911 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.499397 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.499719 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.500047 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.501011 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.501353 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.501659 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.501991 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.502309 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.502638 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.502957 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.503333 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.503683 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.504021 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.504354 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.504668 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.504982 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.505294 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.505609 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.506333 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.506333 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.506639 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.506843 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.507182 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.507544 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.507801 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.508111 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.508420 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.508732 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.509040 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.509618 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.509930 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.510242 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.510554 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.510870 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.511215 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.511527 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.511841 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.512151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.512780 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.512780 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.513083 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.513413 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.513737 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.514069 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.514389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.514721 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.515038 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.515390 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.516680 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.516680 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.516680 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.516680 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.517281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.517281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.517611 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.517927 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.518244 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.518561 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.518895 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.519266 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.519635 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.519971 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.520299 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.520630 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.520963 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.521286 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.521753 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.521920 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.522243 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.522560 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.522880 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.523221 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.523546 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.523864 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.524183 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.524506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.524827 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.525164 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.525497 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.525816 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.526209 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.526484 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.526840 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.527236 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.527536 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.527873 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.528196 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.528515 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.528829 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 13:11:38.529079 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 13:11:38.550226 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO dbcounter [None req-8e6721ba-69e9-49ba-9cfb-5a9554f4eab2 None None] Registered counter for database nova_api Oct 24 13:11:38.570980 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_db.sqlalchemy.engines [None req-8e6721ba-69e9-49ba-9cfb-5a9554f4eab2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:11:38.577800 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writer thread running {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:11:38.593423 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO dbcounter [None req-33eee4b8-ab1b-47b8-be0d-777e621e7867 None None] Registered counter for database nova_api Oct 24 13:11:38.613926 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_db.sqlalchemy.engines [None req-33eee4b8-ab1b-47b8-be0d-777e621e7867 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:11:38.620693 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writer thread running {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:11:38.635731 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.context [None req-8e6721ba-69e9-49ba-9cfb-5a9554f4eab2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),acff14a8-a78e-4539-91cc-32485716dc9b(cell1) {{(pid=118915) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 13:11:38.639772 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8e6721ba-69e9-49ba-9cfb-5a9554f4eab2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:11:38.640251 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8e6721ba-69e9-49ba-9cfb-5a9554f4eab2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:11:38.642378 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8e6721ba-69e9-49ba-9cfb-5a9554f4eab2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:11:38.643118 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8e6721ba-69e9-49ba-9cfb-5a9554f4eab2 None None] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:11:38.643568 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8e6721ba-69e9-49ba-9cfb-5a9554f4eab2 None None] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:11:38.645575 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8e6721ba-69e9-49ba-9cfb-5a9554f4eab2 None None] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:11:38.647607 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO dbcounter [None req-8e6721ba-69e9-49ba-9cfb-5a9554f4eab2 None None] Registered counter for database nova_cell0 Oct 24 13:11:38.651763 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO dbcounter [None req-8e6721ba-69e9-49ba-9cfb-5a9554f4eab2 None None] Registered counter for database nova_cell1 Oct 24 13:11:38.659850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_db.sqlalchemy.engines [None req-8e6721ba-69e9-49ba-9cfb-5a9554f4eab2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:11:38.662366 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_db.sqlalchemy.engines [None req-8e6721ba-69e9-49ba-9cfb-5a9554f4eab2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:11:38.666542 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writer thread running {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:11:38.678633 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.context [None req-33eee4b8-ab1b-47b8-be0d-777e621e7867 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),acff14a8-a78e-4539-91cc-32485716dc9b(cell1) {{(pid=118914) load_cells /opt/stack/nova/nova/context.py:464}} Oct 24 13:11:38.682679 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-33eee4b8-ab1b-47b8-be0d-777e621e7867 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:11:38.683187 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-33eee4b8-ab1b-47b8-be0d-777e621e7867 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:11:38.684782 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-33eee4b8-ab1b-47b8-be0d-777e621e7867 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:11:38.685504 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-33eee4b8-ab1b-47b8-be0d-777e621e7867 None None] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:11:38.685953 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-33eee4b8-ab1b-47b8-be0d-777e621e7867 None None] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:11:38.688056 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-33eee4b8-ab1b-47b8-be0d-777e621e7867 None None] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:11:38.690050 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO dbcounter [None req-33eee4b8-ab1b-47b8-be0d-777e621e7867 None None] Registered counter for database nova_cell0 Oct 24 13:11:38.694191 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO dbcounter [None req-33eee4b8-ab1b-47b8-be0d-777e621e7867 None None] Registered counter for database nova_cell1 Oct 24 13:11:38.701509 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_db.sqlalchemy.engines [None req-33eee4b8-ab1b-47b8-be0d-777e621e7867 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:11:38.704331 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_db.sqlalchemy.engines [None req-33eee4b8-ab1b-47b8-be0d-777e621e7867 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:11:38.712062 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writer thread running {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:11:38.712620 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writer thread running {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:11:38.805698 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writer thread running {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:11:38.816003 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO dbcounter [None req-8e6721ba-69e9-49ba-9cfb-5a9554f4eab2 None None] Registered counter for database nova_cell0 Oct 24 13:11:38.822651 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_db.sqlalchemy.engines [None req-8e6721ba-69e9-49ba-9cfb-5a9554f4eab2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118915) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:11:38.826960 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writer thread running {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:11:38.861066 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO dbcounter [None req-33eee4b8-ab1b-47b8-be0d-777e621e7867 None None] Registered counter for database nova_cell0 Oct 24 13:11:38.867857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_db.sqlalchemy.engines [None req-33eee4b8-ab1b-47b8-be0d-777e621e7867 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 13:11:38.872290 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writer thread running {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 13:11:39.148572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: WARNING keystonemiddleware.auth_token [None req-8e6721ba-69e9-49ba-9cfb-5a9554f4eab2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:11:39.156184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: WARNING keystonemiddleware.auth_token [None req-8e6721ba-69e9-49ba-9cfb-5a9554f4eab2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:11:39.196056 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: WARNING keystonemiddleware.auth_token [None req-33eee4b8-ab1b-47b8-be0d-777e621e7867 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:11:39.204197 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: WARNING keystonemiddleware.auth_token [None req-33eee4b8-ab1b-47b8-be0d-777e621e7867 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:11:39.519202 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: WARNING keystonemiddleware.auth_token [None req-8e6721ba-69e9-49ba-9cfb-5a9554f4eab2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:11:39.525308 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: WARNING keystonemiddleware.auth_token [None req-8e6721ba-69e9-49ba-9cfb-5a9554f4eab2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:11:39.531599 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556dc5fc89c0 pid: 118915 (default app) Oct 24 13:11:39.566482 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: WARNING keystonemiddleware.auth_token [None req-33eee4b8-ab1b-47b8-be0d-777e621e7867 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 24 13:11:39.572517 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: WARNING keystonemiddleware.auth_token [None req-33eee4b8-ab1b-47b8-be0d-777e621e7867 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 24 13:11:39.577845 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556dc5fc89c0 pid: 118914 (default app) Oct 24 13:12:16.947401 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:SELECT=3 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:16.948421 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=3 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:16.950507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=3 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:16.951583 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=3 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:18.686170 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-d7556368-ff74-42fc-8bcf-35fab0134bf9 tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] Action: 'create', calling method: .version_select at 0x7fad295d6ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1666451548", "metadata": {"Type": "work"}}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:12:18.695949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-d7556368-ff74-42fc-8bcf-35fab0134bf9 tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] Request method failure captured: Oct 24 13:12:18.695949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 24 13:12:18.695949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:12:18.695949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:12:18.695949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:12:18.695949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 122 Oct 24 13:12:18.695949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:12:18.695949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:12:18.695949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:12:18.695949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:12:18.695949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo8wdI4fJ8Suc0gOm3_UTBU_w9DVZreH4Gvrf1kMZavfMbd4dgbFJqLaber1mWyDm6KD3KokZAE99wcjg35ZJFCMGFnY4kEO0ePQc7OSSUwSBOWyBO8gbHo_I74Pfs2BKIeJac_0lbm7ezuS2sIgxuTICZTmrJwguzeJn5_00F3WTr8 Oct 24 13:12:18.695949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:12:18.695949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:12:18.695949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:12:18.695949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:12:18.695949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:12:18.695949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:12:18.695949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: 54de867d20774b7c9d90e8f06795a918 Oct 24 13:12:18.695949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-VolumesNegativeTest-1396831232 Oct 24 13:12:18.695949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:12:18.695949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:12:18.697702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/54de867d20774b7c9d90e8f06795a918"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/54de867d20774b7c9d90e8f06795a918"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/54de867d20774b7c9d90e8f06795a918"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_54de867d20774b7c9d90e8f06795a918"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:12:18.697702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-VolumesNegativeTest-1396831232 Oct 24 13:12:18.697702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: 54de867d20774b7c9d90e8f06795a918 Oct 24 13:12:18.697702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-VolumesNegativeTest-1396831232 Oct 24 13:12:18.697702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-VolumesNegativeTest-1396831232-project Oct 24 13:12:18.697702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:12:18.697702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:12:18.697702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: b8c8e7a6f6a9447a8c24dad629dff6a6 Oct 24 13:12:18.697702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-VolumesNegativeTest-1396831232-project Oct 24 13:12:18.697702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Oct 24 13:12:18.697702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1666451548", "metadata": {"Type": "work"}}} Oct 24 13:12:18.697702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: Oct 24 13:12:18.697702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 24 13:12:18.698795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1666451548', 'metadata': {'Type': 'work'}}}} Oct 24 13:12:18.698795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:12:18.698795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:12:18.698795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 13:12:18.698795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 13:12:18.698795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 13:12:18.698795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise error Oct 24 13:12:18.698795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 24 13:12:18.698795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:12:18.698795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 24 13:12:18.698795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 24 13:12:18.698795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:12:18.698795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 24 13:12:18.698795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi '#$%' Oct 24 13:12:18.698795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:12:18.698795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:12:18.698795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:12:18.698795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:12:18.698795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:12:18.698795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:12:18.698795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:12:18.698795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:12:18.700458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:12:18.700458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:12:18.700458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:12:18.700458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:12:18.700458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 13:12:18.700458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 13:12:18.700458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 13:12:18.700458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 13:12:18.700458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 13:12:18.700458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 13:12:18.700458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 24 13:12:18.700458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:12:18.700458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:12:18.700458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:12:18.700458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:12:18.700458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:12:18.700458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:12:18.700458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 13:12:18.700458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 13:12:18.708369 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 24 13:12:18.708369 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:12:18.715840 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-d7556368-ff74-42fc-8bcf-35fab0134bf9 tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:12:18.716989 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-d7556368-ff74-42fc-8bcf-35fab0134bf9 tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.789509 Oct 24 13:12:18.718633 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1156 bytes} [Mon Oct 24 13:12:16 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1793 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:12:18.731704 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=3 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:18.733255 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=3 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:18.734203 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=3 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:18.739782 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=3 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:19.136956 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-419edfe3-8605-499e-8c0b-cd68f77863e4 tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] Action: 'create', calling method: .version_select at 0x7fad295cf940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-487819206", "metadata": {"Type": "work"}}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:12:19.143588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-419edfe3-8605-499e-8c0b-cd68f77863e4 tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] Request method failure captured: Oct 24 13:12:19.143588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 24 13:12:19.143588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:12:19.143588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:12:19.143588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:12:19.143588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 119 Oct 24 13:12:19.143588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:12:19.143588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:12:19.143588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:12:19.143588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:12:19.143588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVo8wdI4fJ8Suc0gOm3_UTBU_w9DVZreH4Gvrf1kMZavfMbd4dgbFJqLaber1mWyDm6KD3KokZAE99wcjg35ZJFCMGFnY4kEO0ePQc7OSSUwSBOWyBO8gbHo_I74Pfs2BKIeJac_0lbm7ezuS2sIgxuTICZTmrJwguzeJn5_00F3WTr8 Oct 24 13:12:19.143588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:12:19.143588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:12:19.143588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:12:19.143588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:12:19.143588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:12:19.143588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:12:19.143588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: 54de867d20774b7c9d90e8f06795a918 Oct 24 13:12:19.143588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-VolumesNegativeTest-1396831232 Oct 24 13:12:19.143588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:12:19.143588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:12:19.144899 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/54de867d20774b7c9d90e8f06795a918"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/54de867d20774b7c9d90e8f06795a918"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/54de867d20774b7c9d90e8f06795a918"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_54de867d20774b7c9d90e8f06795a918"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:12:19.144899 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-VolumesNegativeTest-1396831232 Oct 24 13:12:19.144899 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: 54de867d20774b7c9d90e8f06795a918 Oct 24 13:12:19.144899 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-VolumesNegativeTest-1396831232 Oct 24 13:12:19.144899 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-VolumesNegativeTest-1396831232-project Oct 24 13:12:19.144899 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:12:19.144899 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:12:19.144899 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: b8c8e7a6f6a9447a8c24dad629dff6a6 Oct 24 13:12:19.144899 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-VolumesNegativeTest-1396831232-project Oct 24 13:12:19.144899 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Oct 24 13:12:19.144899 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-487819206", "metadata": {"Type": "work"}}} Oct 24 13:12:19.144899 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: Oct 24 13:12:19.144899 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 24 13:12:19.145904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-487819206', 'metadata': {'Type': 'work'}}}} Oct 24 13:12:19.145904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:12:19.145904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:12:19.145904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 13:12:19.145904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 13:12:19.145904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 13:12:19.145904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise error Oct 24 13:12:19.145904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 24 13:12:19.145904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:12:19.145904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 24 13:12:19.145904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 24 13:12:19.145904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:12:19.145904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 24 13:12:19.145904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi '0' Oct 24 13:12:19.145904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:12:19.145904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:12:19.145904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:12:19.145904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:12:19.145904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:12:19.145904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:12:19.145904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:12:19.145904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:12:19.147637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:12:19.147637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:12:19.147637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:12:19.147637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:12:19.147637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 13:12:19.147637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 13:12:19.147637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 13:12:19.147637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 13:12:19.147637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 13:12:19.147637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 13:12:19.147637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 24 13:12:19.147637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:12:19.147637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:12:19.147637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:12:19.147637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:12:19.147637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:12:19.147637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:12:19.147637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 13:12:19.147637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 13:12:19.148819 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 24 13:12:19.148819 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:12:19.148819 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-419edfe3-8605-499e-8c0b-cd68f77863e4 tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:12:19.148819 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-419edfe3-8605-499e-8c0b-cd68f77863e4 tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.420047 Oct 24 13:12:19.148819 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 1/2] 10.222.0.42 () {60 vars in 1156 bytes} [Mon Oct 24 13:12:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 422 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:12:19.155549 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-410230f3-813b-4a58-8dec-fc5fbd738a14 tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] Action: 'create', calling method: .version_select at 0x7fad2959ba60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2122131241", "metadata": {"Type": "work"}}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:12:19.159516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-410230f3-813b-4a58-8dec-fc5fbd738a14 tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] Request method failure captured: Oct 24 13:12:19.159516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 24 13:12:19.159516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:12:19.159516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:12:19.159516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:12:19.159516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 119 Oct 24 13:12:19.159516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:12:19.159516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:12:19.159516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:12:19.159516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:12:19.159516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo8wdI4fJ8Suc0gOm3_UTBU_w9DVZreH4Gvrf1kMZavfMbd4dgbFJqLaber1mWyDm6KD3KokZAE99wcjg35ZJFCMGFnY4kEO0ePQc7OSSUwSBOWyBO8gbHo_I74Pfs2BKIeJac_0lbm7ezuS2sIgxuTICZTmrJwguzeJn5_00F3WTr8 Oct 24 13:12:19.159516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:12:19.159516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:12:19.159516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:12:19.159516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:12:19.159516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:12:19.159516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:12:19.159516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: 54de867d20774b7c9d90e8f06795a918 Oct 24 13:12:19.159516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-VolumesNegativeTest-1396831232 Oct 24 13:12:19.159516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:12:19.159516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:12:19.161274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/54de867d20774b7c9d90e8f06795a918"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/54de867d20774b7c9d90e8f06795a918"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/54de867d20774b7c9d90e8f06795a918"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_54de867d20774b7c9d90e8f06795a918"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:12:19.161274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-VolumesNegativeTest-1396831232 Oct 24 13:12:19.161274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: 54de867d20774b7c9d90e8f06795a918 Oct 24 13:12:19.161274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-VolumesNegativeTest-1396831232 Oct 24 13:12:19.161274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-VolumesNegativeTest-1396831232-project Oct 24 13:12:19.161274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:12:19.161274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:12:19.161274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: b8c8e7a6f6a9447a8c24dad629dff6a6 Oct 24 13:12:19.161274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-VolumesNegativeTest-1396831232-project Oct 24 13:12:19.161274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Oct 24 13:12:19.161274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2122131241", "metadata": {"Type": "work"}}} Oct 24 13:12:19.161274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: Oct 24 13:12:19.161274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 24 13:12:19.162222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2122131241', 'metadata': {'Type': 'work'}}}} Oct 24 13:12:19.162222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:12:19.162222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:12:19.162222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 24 13:12:19.162222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 24 13:12:19.162222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 13:12:19.162222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise error Oct 24 13:12:19.162222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 24 13:12:19.162222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:12:19.162222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 24 13:12:19.162222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 24 13:12:19.162222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:12:19.162222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 24 13:12:19.162222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi '' Oct 24 13:12:19.162222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:12:19.162222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:12:19.162222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:12:19.162222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:12:19.162222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:12:19.162222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:12:19.162222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:12:19.162222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:12:19.163769 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:12:19.163769 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:12:19.163769 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:12:19.163769 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:12:19.163769 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 24 13:12:19.163769 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 24 13:12:19.163769 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 24 13:12:19.163769 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 24 13:12:19.163769 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 24 13:12:19.163769 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 24 13:12:19.163769 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 24 13:12:19.163769 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:12:19.163769 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:12:19.163769 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:12:19.163769 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:12:19.163769 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:12:19.163769 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:12:19.163769 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 24 13:12:19.163769 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 24 13:12:19.166179 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 24 13:12:19.166179 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:12:19.167156 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-410230f3-813b-4a58-8dec-fc5fbd738a14 tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:12:19.168765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-410230f3-813b-4a58-8dec-fc5fbd738a14 tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016111 Oct 24 13:12:19.169451 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 2/3] 10.222.0.42 () {60 vars in 1156 bytes} [Mon Oct 24 13:12:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:12:19.182796 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d4770676-392c-45b2-8afc-e19aecacb8a0 tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] Calling method '.version_select at 0x7fad295cf280>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:19.998261 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-d4770676-392c-45b2-8afc-e19aecacb8a0 tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] HTTP exception thrown: Volume tempest-invalid-1317570224 could not be found. Oct 24 13:12:20.006524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d4770676-392c-45b2-8afc-e19aecacb8a0 tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] Request method failure captured: Oct 24 13:12:20.006524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1317570224 HTTP/1.1 Oct 24 13:12:20.006524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:12:20.006524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:12:20.006524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:12:20.006524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:12:20.006524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:12:20.006524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:12:20.006524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:12:20.006524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:12:20.006524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVo8wdI4fJ8Suc0gOm3_UTBU_w9DVZreH4Gvrf1kMZavfMbd4dgbFJqLaber1mWyDm6KD3KokZAE99wcjg35ZJFCMGFnY4kEO0ePQc7OSSUwSBOWyBO8gbHo_I74Pfs2BKIeJac_0lbm7ezuS2sIgxuTICZTmrJwguzeJn5_00F3WTr8 Oct 24 13:12:20.006524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:12:20.006524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:12:20.006524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:12:20.006524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:12:20.006524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:12:20.006524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:12:20.006524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: 54de867d20774b7c9d90e8f06795a918 Oct 24 13:12:20.006524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-VolumesNegativeTest-1396831232 Oct 24 13:12:20.006524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:12:20.006524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:12:20.008060 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/54de867d20774b7c9d90e8f06795a918"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/54de867d20774b7c9d90e8f06795a918"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/54de867d20774b7c9d90e8f06795a918"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_54de867d20774b7c9d90e8f06795a918"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:12:20.008060 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-VolumesNegativeTest-1396831232 Oct 24 13:12:20.008060 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: 54de867d20774b7c9d90e8f06795a918 Oct 24 13:12:20.008060 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-VolumesNegativeTest-1396831232 Oct 24 13:12:20.008060 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-VolumesNegativeTest-1396831232-project Oct 24 13:12:20.008060 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:12:20.008060 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:12:20.008060 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: b8c8e7a6f6a9447a8c24dad629dff6a6 Oct 24 13:12:20.008060 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-VolumesNegativeTest-1396831232-project Oct 24 13:12:20.008060 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: Oct 24 13:12:20.008060 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Volume tempest-invalid-1317570224 could not be found. Oct 24 13:12:20.008060 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': 'tempest-invalid-1317570224'} Oct 24 13:12:20.008060 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:12:20.009103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:12:20.009103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:12:20.009103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:12:20.009103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 13:12:20.009103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 13:12:20.009103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 13:12:20.009103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 13:12:20.009103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 13:12:20.009103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 13:12:20.009103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 13:12:20.009103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 13:12:20.009103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:12:20.009103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:12:20.009103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:12:20.009103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:12:20.009103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1317570224 could not be found. (HTTP 404) (Request-ID: req-297ee630-0ea9-4309-8739-cabbeacf86fd) Oct 24 13:12:20.009103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:12:20.009103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:12:20.009103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:12:20.010745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:12:20.010745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 24 13:12:20.010745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 24 13:12:20.010745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:12:20.010745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:12:20.010745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 13:12:20.010745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 13:12:20.010745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:12:20.010745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:12:20.010745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:12:20.010745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:12:20.010745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 13:12:20.010745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 13:12:20.010745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 13:12:20.010745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 13:12:20.010745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 13:12:20.010745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 13:12:20.010745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 13:12:20.010745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 13:12:20.012529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:12:20.012529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:12:20.012529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:12:20.012529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:12:20.012529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1317570224 could not be found. Oct 24 13:12:20.012529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:12:20.012529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:12:20.012529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:12:20.012529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:12:20.012529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:12:20.012529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:12:20.012529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:12:20.012529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:12:20.012529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:12:20.012529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:12:20.012529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:12:20.012529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:12:20.012529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 24 13:12:20.012529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:12:20.012529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1317570224 could not be found. Oct 24 13:12:20.013904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:12:20.013904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:12:20.013904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:12:20.013904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:12:20.013904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:12:20.013904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:12:20.013904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:12:20.013904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:12:20.013904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1317570224 could not be found. Oct 24 13:12:20.013904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:12:20.016054 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d4770676-392c-45b2-8afc-e19aecacb8a0 tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] Returning 404 to user: Volume tempest-invalid-1317570224 could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:12:20.018825 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-d4770676-392c-45b2-8afc-e19aecacb8a0 tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1317570224" status: 404 len: 99 microversion: 2.1 time: 0.842603 Oct 24 13:12:20.019529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1218 bytes} [Mon Oct 24 13:12:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1317570224 => generated 99 bytes in 844 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 24 13:12:20.029307 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-1e8157fe-daa7-4219-afe5-82e77db9cb5c tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004341 Oct 24 13:12:20.036615 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 3/5] 10.222.0.42 () {58 vars in 1140 bytes} [Mon Oct 24 13:12:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 24 13:12:20.050659 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-cd86778a-8333-4539-8d64-339dc866d406 tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012354 Oct 24 13:12:20.065028 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 3/6] 10.222.0.42 () {58 vars in 1137 bytes} [Mon Oct 24 13:12:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 27 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 24 13:12:20.074609 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-4c09dcf7-d7a8-4a82-95e1-bd8af37d2292 tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] Calling method '.version_select at 0x7fad29550e50>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:20.387856 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-4c09dcf7-d7a8-4a82-95e1-bd8af37d2292 tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] HTTP exception thrown: Volume 912f6a81-269e-4aec-ae69-56d360e51da7 could not be found. Oct 24 13:12:20.393881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-4c09dcf7-d7a8-4a82-95e1-bd8af37d2292 tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] Request method failure captured: Oct 24 13:12:20.393881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: DELETE /compute/v2.1/os-volumes/912f6a81-269e-4aec-ae69-56d360e51da7 HTTP/1.1 Oct 24 13:12:20.393881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:12:20.393881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:12:20.393881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:12:20.393881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:12:20.393881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:12:20.393881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:12:20.393881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:12:20.393881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:12:20.393881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo8wdI4fJ8Suc0gOm3_UTBU_w9DVZreH4Gvrf1kMZavfMbd4dgbFJqLaber1mWyDm6KD3KokZAE99wcjg35ZJFCMGFnY4kEO0ePQc7OSSUwSBOWyBO8gbHo_I74Pfs2BKIeJac_0lbm7ezuS2sIgxuTICZTmrJwguzeJn5_00F3WTr8 Oct 24 13:12:20.393881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:12:20.393881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:12:20.393881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:12:20.393881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:12:20.393881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:12:20.393881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:12:20.393881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: 54de867d20774b7c9d90e8f06795a918 Oct 24 13:12:20.393881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-VolumesNegativeTest-1396831232 Oct 24 13:12:20.393881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:12:20.393881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:12:20.395562 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/54de867d20774b7c9d90e8f06795a918"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/54de867d20774b7c9d90e8f06795a918"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/54de867d20774b7c9d90e8f06795a918"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_54de867d20774b7c9d90e8f06795a918"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:12:20.395562 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-VolumesNegativeTest-1396831232 Oct 24 13:12:20.395562 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: 54de867d20774b7c9d90e8f06795a918 Oct 24 13:12:20.395562 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-VolumesNegativeTest-1396831232 Oct 24 13:12:20.395562 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-VolumesNegativeTest-1396831232-project Oct 24 13:12:20.395562 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:12:20.395562 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:12:20.395562 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: b8c8e7a6f6a9447a8c24dad629dff6a6 Oct 24 13:12:20.395562 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-VolumesNegativeTest-1396831232-project Oct 24 13:12:20.395562 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: Oct 24 13:12:20.395562 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Volume 912f6a81-269e-4aec-ae69-56d360e51da7 could not be found. Oct 24 13:12:20.395562 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': '912f6a81-269e-4aec-ae69-56d360e51da7'} Oct 24 13:12:20.395562 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:12:20.396634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:12:20.396634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:12:20.396634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:12:20.396634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 13:12:20.396634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 13:12:20.396634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 13:12:20.396634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 13:12:20.396634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 13:12:20.396634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 13:12:20.396634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 13:12:20.396634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 13:12:20.396634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:12:20.396634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:12:20.396634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:12:20.396634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:12:20.396634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 912f6a81-269e-4aec-ae69-56d360e51da7 could not be found. (HTTP 404) (Request-ID: req-026654c3-ab64-4bd2-87a4-f2dc4415ead2) Oct 24 13:12:20.396634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:12:20.396634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:12:20.396634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:12:20.397713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:12:20.397713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 24 13:12:20.397713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 24 13:12:20.397713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:12:20.397713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:12:20.397713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 13:12:20.397713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 13:12:20.397713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:12:20.397713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:12:20.397713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:12:20.397713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:12:20.397713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 13:12:20.397713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 13:12:20.397713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 13:12:20.397713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 13:12:20.397713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 13:12:20.397713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 13:12:20.397713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 13:12:20.397713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 13:12:20.398766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:12:20.398766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:12:20.398766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:12:20.398766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:12:20.398766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 912f6a81-269e-4aec-ae69-56d360e51da7 could not be found. Oct 24 13:12:20.398766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:12:20.398766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:12:20.398766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:12:20.398766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:12:20.398766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:12:20.398766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:12:20.398766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:12:20.398766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:12:20.398766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:12:20.398766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:12:20.398766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:12:20.398766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:12:20.398766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 24 13:12:20.398766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:12:20.400339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 912f6a81-269e-4aec-ae69-56d360e51da7 could not be found. Oct 24 13:12:20.400339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:12:20.400339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:12:20.400339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:12:20.400339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:12:20.400339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:12:20.400339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:12:20.400339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:12:20.400339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:12:20.400339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 912f6a81-269e-4aec-ae69-56d360e51da7 could not be found. Oct 24 13:12:20.400339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:12:20.400339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-4c09dcf7-d7a8-4a82-95e1-bd8af37d2292 tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] Returning 404 to user: Volume 912f6a81-269e-4aec-ae69-56d360e51da7 could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:12:20.402256 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-4c09dcf7-d7a8-4a82-95e1-bd8af37d2292 tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/912f6a81-269e-4aec-ae69-56d360e51da7" status: 404 len: 109 microversion: 2.1 time: 0.332201 Oct 24 13:12:20.404115 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Oct 24 13:12:20 2022] DELETE /compute/v2.1/os-volumes/912f6a81-269e-4aec-ae69-56d360e51da7 => generated 109 bytes in 335 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:12:20.435093 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-30d3b6d5-cc37-447a-bc66-6d53e6352dab tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] Calling method '.version_select at 0x7fad29361280>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:20.548236 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-30d3b6d5-cc37-447a-bc66-6d53e6352dab tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] HTTP exception thrown: Volume 370d76a1-20d1-46c9-a7de-d61b1d32ea48 could not be found. Oct 24 13:12:20.561035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-30d3b6d5-cc37-447a-bc66-6d53e6352dab tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] Request method failure captured: Oct 24 13:12:20.561035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: GET /compute/v2.1/os-volumes/370d76a1-20d1-46c9-a7de-d61b1d32ea48 HTTP/1.1 Oct 24 13:12:20.561035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:12:20.561035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:12:20.561035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:12:20.561035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:12:20.561035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:12:20.561035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:12:20.561035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:12:20.561035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:12:20.561035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVo8wdI4fJ8Suc0gOm3_UTBU_w9DVZreH4Gvrf1kMZavfMbd4dgbFJqLaber1mWyDm6KD3KokZAE99wcjg35ZJFCMGFnY4kEO0ePQc7OSSUwSBOWyBO8gbHo_I74Pfs2BKIeJac_0lbm7ezuS2sIgxuTICZTmrJwguzeJn5_00F3WTr8 Oct 24 13:12:20.561035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:12:20.561035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:12:20.561035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:12:20.561035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:12:20.561035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:12:20.561035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:12:20.561035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: 54de867d20774b7c9d90e8f06795a918 Oct 24 13:12:20.561035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-VolumesNegativeTest-1396831232 Oct 24 13:12:20.561035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:12:20.561035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:12:20.562993 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/54de867d20774b7c9d90e8f06795a918"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/54de867d20774b7c9d90e8f06795a918"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/54de867d20774b7c9d90e8f06795a918"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_54de867d20774b7c9d90e8f06795a918"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:12:20.562993 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-VolumesNegativeTest-1396831232 Oct 24 13:12:20.562993 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: 54de867d20774b7c9d90e8f06795a918 Oct 24 13:12:20.562993 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-VolumesNegativeTest-1396831232 Oct 24 13:12:20.562993 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-VolumesNegativeTest-1396831232-project Oct 24 13:12:20.562993 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:12:20.562993 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:12:20.562993 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: b8c8e7a6f6a9447a8c24dad629dff6a6 Oct 24 13:12:20.562993 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-VolumesNegativeTest-1396831232-project Oct 24 13:12:20.562993 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: Oct 24 13:12:20.562993 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Volume 370d76a1-20d1-46c9-a7de-d61b1d32ea48 could not be found. Oct 24 13:12:20.562993 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': '370d76a1-20d1-46c9-a7de-d61b1d32ea48'} Oct 24 13:12:20.562993 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:12:20.563771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:12:20.563771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:12:20.563771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:12:20.563771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:12:20.563771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:12:20.563771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:12:20.563771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:12:20.563771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:12:20.563771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:12:20.563771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:12:20.563771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:12:20.563771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:12:20.563771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:12:20.563771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:12:20.563771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:12:20.563771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 370d76a1-20d1-46c9-a7de-d61b1d32ea48 could not be found. (HTTP 404) (Request-ID: req-c9b6dce3-95a1-4be7-af3c-6531e337ab2e) Oct 24 13:12:20.563771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:12:20.563771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:12:20.563771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:12:20.564887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:12:20.564887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 13:12:20.564887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 13:12:20.564887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:12:20.564887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:12:20.564887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 13:12:20.564887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 13:12:20.564887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:12:20.564887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:12:20.564887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:12:20.564887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:12:20.564887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:12:20.564887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:12:20.564887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:12:20.564887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:12:20.564887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:12:20.564887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:12:20.564887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:12:20.564887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:12:20.565989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:12:20.565989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:12:20.565989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:12:20.565989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:12:20.565989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 370d76a1-20d1-46c9-a7de-d61b1d32ea48 could not be found. Oct 24 13:12:20.565989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:12:20.565989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:12:20.565989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:12:20.565989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:12:20.565989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:12:20.565989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:12:20.565989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:12:20.565989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:12:20.565989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:12:20.565989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:12:20.565989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:12:20.565989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:12:20.565989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 13:12:20.565989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:12:20.567882 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 370d76a1-20d1-46c9-a7de-d61b1d32ea48 could not be found. Oct 24 13:12:20.567882 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:12:20.567882 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:12:20.567882 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:12:20.567882 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:12:20.567882 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:12:20.567882 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:12:20.567882 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:12:20.567882 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:12:20.567882 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 370d76a1-20d1-46c9-a7de-d61b1d32ea48 could not be found. Oct 24 13:12:20.567882 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:12:20.571917 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-30d3b6d5-cc37-447a-bc66-6d53e6352dab tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] Returning 404 to user: Volume 370d76a1-20d1-46c9-a7de-d61b1d32ea48 could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:12:20.576426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-30d3b6d5-cc37-447a-bc66-6d53e6352dab tempest-VolumesNegativeTest-1396831232 tempest-VolumesNegativeTest-1396831232-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/370d76a1-20d1-46c9-a7de-d61b1d32ea48" status: 404 len: 109 microversion: 2.1 time: 0.161985 Oct 24 13:12:20.588192 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 24 13:12:20 2022] GET /compute/v2.1/os-volumes/370d76a1-20d1-46c9-a7de-d61b1d32ea48 => generated 109 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:12:32.559432 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-4130c580-87f9-4104-8081-87134fe04fce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1867596342", "imageRef": "4d2e5f3e-4aee-48d2-8ada-0b420d141f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:12:32.611959 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-5cb6e38c-6879-44c2-b466-c0a70582ead0 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1047689783", "imageRef": "4d2e5f3e-4aee-48d2-8ada-0b420d141f1b", "flavorRef": "452", "networks": [{"uuid": "23dbd5dc-76ff-4551-9eb1-d593c4c4a0f2"}]}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:12:32.853410 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.network.neutron [None req-4130c580-87f9-4104-8081-87134fe04fce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] validate_networks() for [('55317d88-e8da-40f9-8cad-037adf7670ee', None, None, None, None, None)] {{(pid=118914) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:12:32.897720 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.network.neutron [None req-5cb6e38c-6879-44c2-b466-c0a70582ead0 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] validate_networks() for [('23dbd5dc-76ff-4551-9eb1-d593c4c4a0f2', None, None, None, None, None)] {{(pid=118915) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:12:34.979855 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-4130c580-87f9-4104-8081-87134fe04fce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Flavor limits 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:12:34.980364 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-4130c580-87f9-4104-8081-87134fe04fce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Image limits 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:12:34.980815 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-4130c580-87f9-4104-8081-87134fe04fce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Flavor pref 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:12:34.981270 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-4130c580-87f9-4104-8081-87134fe04fce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Image pref 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:12:34.981695 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-4130c580-87f9-4104-8081-87134fe04fce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:12:35.025978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4130c580-87f9-4104-8081-87134fe04fce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:35.025978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4130c580-87f9-4104-8081-87134fe04fce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:35.025978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4130c580-87f9-4104-8081-87134fe04fce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:35.025978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4130c580-87f9-4104-8081-87134fe04fce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:35.026665 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4130c580-87f9-4104-8081-87134fe04fce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:35.053254 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4130c580-87f9-4104-8081-87134fe04fce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:35.152497 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-4130c580-87f9-4104-8081-87134fe04fce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Getting quotas for project 85d62dec32104e7b8c595953a479026b. Resources: {'cores', 'instances', 'ram'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:12:35.174858 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-4130c580-87f9-4104-8081-87134fe04fce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Getting quotas for user d29ff25b062346f6bcf9910b1fa8db5c and project 85d62dec32104e7b8c595953a479026b. Resources: {'cores', 'instances', 'ram'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:12:35.209269 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-4130c580-87f9-4104-8081-87134fe04fce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Going to run 1 instances... {{(pid=118914) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:12:35.212190 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-4130c580-87f9-4104-8081-87134fe04fce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4d2e5f3e-4aee-48d2-8ada-0b420d141f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:12:35.408992 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-4130c580-87f9-4104-8081-87134fe04fce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.520762 Oct 24 13:12:35.417078 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 5/9] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 24 13:12:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 3529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 13:12:35.823912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-5cb6e38c-6879-44c2-b466-c0a70582ead0 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Flavor limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:12:35.825020 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-5cb6e38c-6879-44c2-b466-c0a70582ead0 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Image limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:12:35.825507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-5cb6e38c-6879-44c2-b466-c0a70582ead0 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Flavor pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:12:35.825920 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-5cb6e38c-6879-44c2-b466-c0a70582ead0 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Image pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:12:35.826330 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-5cb6e38c-6879-44c2-b466-c0a70582ead0 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:12:35.874945 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5cb6e38c-6879-44c2-b466-c0a70582ead0 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:35.875885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5cb6e38c-6879-44c2-b466-c0a70582ead0 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:35.876502 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5cb6e38c-6879-44c2-b466-c0a70582ead0 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:35.877471 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5cb6e38c-6879-44c2-b466-c0a70582ead0 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:35.879660 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5cb6e38c-6879-44c2-b466-c0a70582ead0 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:35.880289 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5cb6e38c-6879-44c2-b466-c0a70582ead0 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:35.949389 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-5cb6e38c-6879-44c2-b466-c0a70582ead0 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Getting quotas for project c837e1766e0141ea9b868b89efee5ba1. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:12:35.966193 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-5cb6e38c-6879-44c2-b466-c0a70582ead0 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Getting quotas for user b3e637d319f449f38e4d6375ae5b22fc and project c837e1766e0141ea9b868b89efee5ba1. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:12:35.995606 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-5cb6e38c-6879-44c2-b466-c0a70582ead0 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Going to run 1 instances... {{(pid=118915) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:12:35.999638 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-5cb6e38c-6879-44c2-b466-c0a70582ead0 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4d2e5f3e-4aee-48d2-8ada-0b420d141f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:12:36.149699 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-5cb6e38c-6879-44c2-b466-c0a70582ead0 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.427200 Oct 24 13:12:36.150747 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-6c30192f-7e9d-4c57-9325-d23c137d1561 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Action: 'create', calling method: .version_select at 0x7fad28a62940>, body: {"keypair": {"name": "tempest-keypair-1141128944", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxhBUz2tbMqdiX0Z5r7lsV5FhKHW1uQIeNblC0+tCtDy/J8MidcUL7N1/iudhevVwYeIF9zsixxSxnTjkae10/uxwYo8AZweFgzVHS26kWHo55wD02jKsmP1DzY1Tgf6A=="}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:12:36.163400 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 5/10] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 24 13:12:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 4442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:12:36.202848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-6c30192f-7e9d-4c57-9325-d23c137d1561 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Getting quotas for project 69beb82dd21b447d8a784e0570c4323c. Resources: {'key_pairs'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:12:36.210422 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-6c30192f-7e9d-4c57-9325-d23c137d1561 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Getting quotas for user c5619c8183e04e1d9073f1b40e057967 and project 69beb82dd21b447d8a784e0570c4323c. Resources: {'key_pairs'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:12:36.335707 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-6c30192f-7e9d-4c57-9325-d23c137d1561 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.917320 Oct 24 13:12:36.339018 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 6/11] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Oct 24 13:12:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:12:36.364728 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-41934f5d-a58c-4bb4-a8a3-bc5288c55bd1 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:36.369754 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-41934f5d-a58c-4bb4-a8a3-bc5288c55bd1 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:36.611215 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-41934f5d-a58c-4bb4-a8a3-bc5288c55bd1 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:36.646429 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-41934f5d-a58c-4bb4-a8a3-bc5288c55bd1 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1222 microversion: 2.1 time: 0.293649 Oct 24 13:12:36.648274 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 7/12] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:36 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1222 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:36.664564 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-8da90b39-fef6-4bdc-b368-caf1c49538b7 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:36.665336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-8da90b39-fef6-4bdc-b368-caf1c49538b7 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:36.928463 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-8da90b39-fef6-4bdc-b368-caf1c49538b7 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e637d319f449f38e4d6375ae5b22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c837e1766e0141ea9b868b89efee5ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:36.938899 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-8da90b39-fef6-4bdc-b368-caf1c49538b7 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 200 len: 1215 microversion: 2.1 time: 0.289302 Oct 24 13:12:36.946398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 8/13] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:36 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 1215 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:37.494615 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-fa646af0-f35d-4d9a-b37f-c0cd3ed263ef tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-675061307", "imageRef": "4d2e5f3e-4aee-48d2-8ada-0b420d141f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:12:37.610097 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.network.neutron [None req-fa646af0-f35d-4d9a-b37f-c0cd3ed263ef tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] validate_networks() for [('55317d88-e8da-40f9-8cad-037adf7670ee', None, None, None, None, None)] {{(pid=118914) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:12:37.629397 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-cb5aa9d1-3d9d-4f9b-94c0-a919e4b488ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Action: 'create', calling method: .version_select at 0x7fad28a67e50>, body: {"keypair": {"name": "tempest-keypair-989564064", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiJmU/oA6scadVcKXBkxFzUxKfHfhmPOvF0jPS2XMaJJieC6KXAgTBCjmZxDEgLDJCzbZp7+ihjky8DiN/ZOol1U/3t7/1707o497r8la0IXKUe3bCncOEnIqiKOkZ62g=="}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:12:37.730730 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-cb5aa9d1-3d9d-4f9b-94c0-a919e4b488ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Getting quotas for project b736b09b6ee2492590cbc23db48752f4. Resources: {'key_pairs'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:12:37.754898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-cb5aa9d1-3d9d-4f9b-94c0-a919e4b488ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Getting quotas for user 3e02f6f701324af6b53762569f1a9d21 and project b736b09b6ee2492590cbc23db48752f4. Resources: {'key_pairs'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:12:37.932347 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-cb5aa9d1-3d9d-4f9b-94c0-a919e4b488ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.764298 Oct 24 13:12:37.933895 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 6/14] 10.222.0.42 () {62 vars in 1200 bytes} [Mon Oct 24 13:12:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1770 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 24 13:12:37.974765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-6b53afd8-4c61-4d34-9e2e-a1f90aa38f9a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:37.975843 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-6b53afd8-4c61-4d34-9e2e-a1f90aa38f9a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:38.369717 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-6b53afd8-4c61-4d34-9e2e-a1f90aa38f9a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e637d319f449f38e4d6375ae5b22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c837e1766e0141ea9b868b89efee5ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:38.413020 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-6b53afd8-4c61-4d34-9e2e-a1f90aa38f9a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 200 len: 1215 microversion: 2.1 time: 0.440743 Oct 24 13:12:38.413636 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 7/15] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:37 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 1215 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:39.381984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-fa646af0-f35d-4d9a-b37f-c0cd3ed263ef tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Flavor limits 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:12:39.382589 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-fa646af0-f35d-4d9a-b37f-c0cd3ed263ef tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Image limits 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:12:39.382950 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-fa646af0-f35d-4d9a-b37f-c0cd3ed263ef tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Flavor pref 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:12:39.383382 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-fa646af0-f35d-4d9a-b37f-c0cd3ed263ef tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Image pref 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:12:39.383794 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-fa646af0-f35d-4d9a-b37f-c0cd3ed263ef tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:12:39.409825 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa646af0-f35d-4d9a-b37f-c0cd3ed263ef tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:39.410350 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa646af0-f35d-4d9a-b37f-c0cd3ed263ef tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:39.410789 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa646af0-f35d-4d9a-b37f-c0cd3ed263ef tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:39.411912 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa646af0-f35d-4d9a-b37f-c0cd3ed263ef tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:39.412116 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa646af0-f35d-4d9a-b37f-c0cd3ed263ef tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:39.412397 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa646af0-f35d-4d9a-b37f-c0cd3ed263ef tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:39.442274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-968297e7-ce73-42d2-be0b-888f6386f6a2 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:39.442893 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-968297e7-ce73-42d2-be0b-888f6386f6a2 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:39.451200 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-968297e7-ce73-42d2-be0b-888f6386f6a2 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:39.458368 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-968297e7-ce73-42d2-be0b-888f6386f6a2 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:39.458982 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-968297e7-ce73-42d2-be0b-888f6386f6a2 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:39.459930 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-968297e7-ce73-42d2-be0b-888f6386f6a2 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:39.461587 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-968297e7-ce73-42d2-be0b-888f6386f6a2 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:39.465336 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-968297e7-ce73-42d2-be0b-888f6386f6a2 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:39.517802 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-fa646af0-f35d-4d9a-b37f-c0cd3ed263ef tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Getting quotas for project 85d62dec32104e7b8c595953a479026b. Resources: {'cores', 'instances', 'ram'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:12:39.535868 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-fa646af0-f35d-4d9a-b37f-c0cd3ed263ef tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Getting quotas for user d29ff25b062346f6bcf9910b1fa8db5c and project 85d62dec32104e7b8c595953a479026b. Resources: {'cores', 'instances', 'ram'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:12:39.589864 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-fa646af0-f35d-4d9a-b37f-c0cd3ed263ef tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Going to run 1 instances... {{(pid=118914) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:12:39.592104 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-fa646af0-f35d-4d9a-b37f-c0cd3ed263ef tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4d2e5f3e-4aee-48d2-8ada-0b420d141f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:12:39.772310 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-fa646af0-f35d-4d9a-b37f-c0cd3ed263ef tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.282206 Oct 24 13:12:39.785865 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 9/16] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 24 13:12:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 2297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 13:12:39.800436 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-637bdf42-0c2e-4760-8280-d86511f6018f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:39.801111 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-637bdf42-0c2e-4760-8280-d86511f6018f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:40.052630 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-637bdf42-0c2e-4760-8280-d86511f6018f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:40.065541 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-637bdf42-0c2e-4760-8280-d86511f6018f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1221 microversion: 2.1 time: 0.278283 Oct 24 13:12:40.087485 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 10/17] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:39 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1221 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:40.399144 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-968297e7-ce73-42d2-be0b-888f6386f6a2 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e637d319f449f38e4d6375ae5b22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c837e1766e0141ea9b868b89efee5ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:40.433666 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-968297e7-ce73-42d2-be0b-888f6386f6a2 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 200 len: 1275 microversion: 2.1 time: 0.994448 Oct 24 13:12:40.436209 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 8/18] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:39 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 1275 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:12:41.093637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d13d1355-75b9-4c32-8982-b54c14f3b9c8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:41.094749 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-d13d1355-75b9-4c32-8982-b54c14f3b9c8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:41.116304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d13d1355-75b9-4c32-8982-b54c14f3b9c8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:41.119171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d13d1355-75b9-4c32-8982-b54c14f3b9c8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:41.121813 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d13d1355-75b9-4c32-8982-b54c14f3b9c8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:41.122575 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d13d1355-75b9-4c32-8982-b54c14f3b9c8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:41.128676 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d13d1355-75b9-4c32-8982-b54c14f3b9c8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:41.129299 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d13d1355-75b9-4c32-8982-b54c14f3b9c8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:41.462144 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-93afccdb-060d-46a6-9cba-192a6096bf1f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:41.462985 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-93afccdb-060d-46a6-9cba-192a6096bf1f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:41.482462 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-93afccdb-060d-46a6-9cba-192a6096bf1f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:41.482956 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-93afccdb-060d-46a6-9cba-192a6096bf1f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:41.484048 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-93afccdb-060d-46a6-9cba-192a6096bf1f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:41.484941 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-93afccdb-060d-46a6-9cba-192a6096bf1f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:41.485406 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-93afccdb-060d-46a6-9cba-192a6096bf1f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:41.485839 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-93afccdb-060d-46a6-9cba-192a6096bf1f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:41.676686 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-93afccdb-060d-46a6-9cba-192a6096bf1f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e637d319f449f38e4d6375ae5b22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c837e1766e0141ea9b868b89efee5ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:41.686313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-93afccdb-060d-46a6-9cba-192a6096bf1f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 200 len: 1273 microversion: 2.1 time: 0.228412 Oct 24 13:12:41.701082 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 9/19] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:41 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 1273 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:42.295595 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-d13d1355-75b9-4c32-8982-b54c14f3b9c8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:42.336396 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-d13d1355-75b9-4c32-8982-b54c14f3b9c8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1217 microversion: 2.1 time: 1.248340 Oct 24 13:12:42.352365 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 11/20] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:41 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1217 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:42.715025 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-df71f3a0-452f-40a1-b94a-8abe3132ad9d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:42.715780 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-df71f3a0-452f-40a1-b94a-8abe3132ad9d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:42.739534 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-df71f3a0-452f-40a1-b94a-8abe3132ad9d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:42.742118 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-df71f3a0-452f-40a1-b94a-8abe3132ad9d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:42.745361 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-df71f3a0-452f-40a1-b94a-8abe3132ad9d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:42.746169 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-df71f3a0-452f-40a1-b94a-8abe3132ad9d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:42.746754 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-df71f3a0-452f-40a1-b94a-8abe3132ad9d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:42.747120 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-df71f3a0-452f-40a1-b94a-8abe3132ad9d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:43.382984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-354e9223-e46f-4c38-a645-dec7ff861743 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:43.386342 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-354e9223-e46f-4c38-a645-dec7ff861743 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:43.402917 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-354e9223-e46f-4c38-a645-dec7ff861743 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:43.403649 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-354e9223-e46f-4c38-a645-dec7ff861743 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:43.404295 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-354e9223-e46f-4c38-a645-dec7ff861743 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:43.406028 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-354e9223-e46f-4c38-a645-dec7ff861743 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:43.407846 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-354e9223-e46f-4c38-a645-dec7ff861743 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:43.410649 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-354e9223-e46f-4c38-a645-dec7ff861743 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:43.821017 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-df71f3a0-452f-40a1-b94a-8abe3132ad9d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e637d319f449f38e4d6375ae5b22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c837e1766e0141ea9b868b89efee5ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:43.854600 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-df71f3a0-452f-40a1-b94a-8abe3132ad9d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 200 len: 1273 microversion: 2.1 time: 1.141712 Oct 24 13:12:43.858800 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 10/21] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:42 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 1273 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:44.097441 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-354e9223-e46f-4c38-a645-dec7ff861743 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:44.109880 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-354e9223-e46f-4c38-a645-dec7ff861743 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1279 microversion: 2.1 time: 0.734191 Oct 24 13:12:44.112853 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 12/22] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:43 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1279 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:44.889948 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-c81759a7-d95c-4967-a9cb-8ec8d91e0e01 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:44.890720 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-c81759a7-d95c-4967-a9cb-8ec8d91e0e01 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:44.906589 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c81759a7-d95c-4967-a9cb-8ec8d91e0e01 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:44.907161 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c81759a7-d95c-4967-a9cb-8ec8d91e0e01 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:44.907605 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c81759a7-d95c-4967-a9cb-8ec8d91e0e01 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:44.908335 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c81759a7-d95c-4967-a9cb-8ec8d91e0e01 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:44.908791 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c81759a7-d95c-4967-a9cb-8ec8d91e0e01 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:44.914978 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c81759a7-d95c-4967-a9cb-8ec8d91e0e01 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:45.138980 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-edc19626-b45b-47d2-8959-44d1fc6828b7 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:45.148093 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-edc19626-b45b-47d2-8959-44d1fc6828b7 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:45.158151 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-c81759a7-d95c-4967-a9cb-8ec8d91e0e01 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e637d319f449f38e4d6375ae5b22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c837e1766e0141ea9b868b89efee5ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:45.168002 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-edc19626-b45b-47d2-8959-44d1fc6828b7 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:45.172894 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-edc19626-b45b-47d2-8959-44d1fc6828b7 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:45.173423 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-edc19626-b45b-47d2-8959-44d1fc6828b7 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:45.174173 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-edc19626-b45b-47d2-8959-44d1fc6828b7 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:45.175236 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-c81759a7-d95c-4967-a9cb-8ec8d91e0e01 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 200 len: 1273 microversion: 2.1 time: 0.297300 Oct 24 13:12:45.179437 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 11/23] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:44 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 1273 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:45.197621 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-edc19626-b45b-47d2-8959-44d1fc6828b7 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:45.198448 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-edc19626-b45b-47d2-8959-44d1fc6828b7 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:45.385674 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-edc19626-b45b-47d2-8959-44d1fc6828b7 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:45.407593 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-edc19626-b45b-47d2-8959-44d1fc6828b7 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1279 microversion: 2.1 time: 0.274657 Oct 24 13:12:45.408191 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 13/24] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:45 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1279 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:46.203852 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-ab2a2eab-caaf-4d34-8845-fd3793692113 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:46.205048 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-ab2a2eab-caaf-4d34-8845-fd3793692113 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:46.208860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=2 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:46.235862 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ab2a2eab-caaf-4d34-8845-fd3793692113 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:46.235862 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ab2a2eab-caaf-4d34-8845-fd3793692113 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:46.235862 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ab2a2eab-caaf-4d34-8845-fd3793692113 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:46.235862 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ab2a2eab-caaf-4d34-8845-fd3793692113 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:46.236310 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ab2a2eab-caaf-4d34-8845-fd3793692113 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:46.236310 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ab2a2eab-caaf-4d34-8845-fd3793692113 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:46.434698 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-6a4c0d6e-7152-4060-925a-9db9946eecb5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:46.435365 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-6a4c0d6e-7152-4060-925a-9db9946eecb5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:46.451454 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6a4c0d6e-7152-4060-925a-9db9946eecb5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:46.457677 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6a4c0d6e-7152-4060-925a-9db9946eecb5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:46.458245 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6a4c0d6e-7152-4060-925a-9db9946eecb5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:46.465857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6a4c0d6e-7152-4060-925a-9db9946eecb5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:46.466647 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6a4c0d6e-7152-4060-925a-9db9946eecb5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:46.472710 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6a4c0d6e-7152-4060-925a-9db9946eecb5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:47.628490 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-6a4c0d6e-7152-4060-925a-9db9946eecb5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:47.650241 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-6a4c0d6e-7152-4060-925a-9db9946eecb5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1279 microversion: 2.1 time: 1.218705 Oct 24 13:12:47.663210 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 14/25] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:46 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1279 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:12:47.731121 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-ab2a2eab-caaf-4d34-8845-fd3793692113 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e637d319f449f38e4d6375ae5b22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c837e1766e0141ea9b868b89efee5ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:47.746415 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-ab2a2eab-caaf-4d34-8845-fd3793692113 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 200 len: 1315 microversion: 2.1 time: 1.547009 Oct 24 13:12:47.747278 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 12/26] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:46 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 1315 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:48.676025 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-3b4a4a27-4b16-4dd0-9806-6a7ff7266401 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:48.676779 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-3b4a4a27-4b16-4dd0-9806-6a7ff7266401 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:48.689950 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3b4a4a27-4b16-4dd0-9806-6a7ff7266401 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:48.690875 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3b4a4a27-4b16-4dd0-9806-6a7ff7266401 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:48.691712 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3b4a4a27-4b16-4dd0-9806-6a7ff7266401 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:48.692933 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3b4a4a27-4b16-4dd0-9806-6a7ff7266401 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:48.693677 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3b4a4a27-4b16-4dd0-9806-6a7ff7266401 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:48.694265 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3b4a4a27-4b16-4dd0-9806-6a7ff7266401 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:48.777339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-704b78f9-646c-4f6c-9ce6-22b029c1e648 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:48.778034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-704b78f9-646c-4f6c-9ce6-22b029c1e648 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:48.786254 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=12 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:48.790601 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-704b78f9-646c-4f6c-9ce6-22b029c1e648 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:48.793905 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-704b78f9-646c-4f6c-9ce6-22b029c1e648 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:48.794510 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-704b78f9-646c-4f6c-9ce6-22b029c1e648 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:48.795566 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-704b78f9-646c-4f6c-9ce6-22b029c1e648 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:48.796328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-704b78f9-646c-4f6c-9ce6-22b029c1e648 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:48.798924 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-704b78f9-646c-4f6c-9ce6-22b029c1e648 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:49.451727 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=4 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:49.738802 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-3b4a4a27-4b16-4dd0-9806-6a7ff7266401 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:49.752997 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-3b4a4a27-4b16-4dd0-9806-6a7ff7266401 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1321 microversion: 2.1 time: 1.083422 Oct 24 13:12:49.754766 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 15/27] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:48 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1321 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:49.772194 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-3c64b8cf-4879-41ee-b78e-1ed4518c3176 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2098653726", "imageRef": "4d2e5f3e-4aee-48d2-8ada-0b420d141f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a05f0bd2-3e3c-4265-bb55-173e62bd1853"}], "security_groups": [{"name": "tempest-securitygroup--970917626"}], "key_name": "tempest-keypair-1141128944", "user_data": "}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:12:50.022381 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.network.neutron [None req-3c64b8cf-4879-41ee-b78e-1ed4518c3176 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] validate_networks() for [('a05f0bd2-3e3c-4265-bb55-173e62bd1853', None, None, None, None, None)] {{(pid=118914) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:12:50.064241 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=22 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:51.546993 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-704b78f9-646c-4f6c-9ce6-22b029c1e648 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e637d319f449f38e4d6375ae5b22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c837e1766e0141ea9b868b89efee5ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:51.557029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-704b78f9-646c-4f6c-9ce6-22b029c1e648 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 200 len: 1315 microversion: 2.1 time: 2.783682 Oct 24 13:12:51.580621 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 13/28] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:48 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 1315 bytes in 2808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:51.586663 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-1fc403c4-235a-4b7a-897c-6ece4d5efcfc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1582832783", "imageRef": "4d2e5f3e-4aee-48d2-8ada-0b420d141f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d6737bc-d513-4e59-9015-d238c58ac0c3"}], "security_groups": [{"name": "tempest-securitygroup--1252984"}], "key_name": "tempest-keypair-989564064", "user_data": "}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:12:51.849161 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-3c64b8cf-4879-41ee-b78e-1ed4518c3176 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Flavor limits 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:12:51.849644 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-3c64b8cf-4879-41ee-b78e-1ed4518c3176 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Image limits 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:12:51.850167 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-3c64b8cf-4879-41ee-b78e-1ed4518c3176 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Flavor pref 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:12:51.850441 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-3c64b8cf-4879-41ee-b78e-1ed4518c3176 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Image pref 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:12:51.850998 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-3c64b8cf-4879-41ee-b78e-1ed4518c3176 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:12:51.881775 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3c64b8cf-4879-41ee-b78e-1ed4518c3176 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:51.882400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3c64b8cf-4879-41ee-b78e-1ed4518c3176 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:51.882863 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3c64b8cf-4879-41ee-b78e-1ed4518c3176 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:51.883736 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3c64b8cf-4879-41ee-b78e-1ed4518c3176 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:51.884205 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3c64b8cf-4879-41ee-b78e-1ed4518c3176 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:51.884877 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3c64b8cf-4879-41ee-b78e-1ed4518c3176 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:51.975197 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-3c64b8cf-4879-41ee-b78e-1ed4518c3176 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Getting quotas for project 69beb82dd21b447d8a784e0570c4323c. Resources: {'cores', 'instances', 'ram'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:12:51.980419 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-3c64b8cf-4879-41ee-b78e-1ed4518c3176 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Getting quotas for user c5619c8183e04e1d9073f1b40e057967 and project 69beb82dd21b447d8a784e0570c4323c. Resources: {'cores', 'instances', 'ram'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:12:51.997208 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-3c64b8cf-4879-41ee-b78e-1ed4518c3176 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Going to run 1 instances... {{(pid=118914) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:12:52.000535 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-3c64b8cf-4879-41ee-b78e-1ed4518c3176 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4d2e5f3e-4aee-48d2-8ada-0b420d141f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:12:52.008108 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.network.neutron [None req-1fc403c4-235a-4b7a-897c-6ece4d5efcfc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] validate_networks() for [('5d6737bc-d513-4e59-9015-d238c58ac0c3', None, None, None, None, None)] {{(pid=118915) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:12:52.118232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-3c64b8cf-4879-41ee-b78e-1ed4518c3176 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.362051 Oct 24 13:12:52.128012 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 16/29] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 24 13:12:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 2372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:12:52.134542 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-63483c0b-efb7-420d-9d71-18d9030960ae tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:52.138557 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-63483c0b-efb7-420d-9d71-18d9030960ae tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:52.148028 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-63483c0b-efb7-420d-9d71-18d9030960ae tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:52.149019 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-63483c0b-efb7-420d-9d71-18d9030960ae tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:52.149660 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-63483c0b-efb7-420d-9d71-18d9030960ae tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:52.151884 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-63483c0b-efb7-420d-9d71-18d9030960ae tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:52.152614 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-63483c0b-efb7-420d-9d71-18d9030960ae tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:52.153706 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-63483c0b-efb7-420d-9d71-18d9030960ae tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:52.982746 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-63483c0b-efb7-420d-9d71-18d9030960ae tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:53.009159 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-63483c0b-efb7-420d-9d71-18d9030960ae tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1321 microversion: 2.1 time: 0.876441 Oct 24 13:12:53.011015 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 17/30] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:52 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1321 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:53.033234 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-f32e25cb-fa04-4b60-b9b0-0bfb6081bdd4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:53.035028 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-f32e25cb-fa04-4b60-b9b0-0bfb6081bdd4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:53.186693 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-f32e25cb-fa04-4b60-b9b0-0bfb6081bdd4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:53.195575 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-f32e25cb-fa04-4b60-b9b0-0bfb6081bdd4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b" status: 200 len: 1242 microversion: 2.1 time: 0.177293 Oct 24 13:12:53.207633 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 18/31] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:53 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b => generated 1242 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:53.214406 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-1b6a0f59-f6a1-4765-8218-ed1f88944b74 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:53.215318 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-1b6a0f59-f6a1-4765-8218-ed1f88944b74 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:53.240634 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1b6a0f59-f6a1-4765-8218-ed1f88944b74 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:53.241511 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1b6a0f59-f6a1-4765-8218-ed1f88944b74 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:53.243522 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1b6a0f59-f6a1-4765-8218-ed1f88944b74 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:53.244600 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1b6a0f59-f6a1-4765-8218-ed1f88944b74 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:53.248496 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1b6a0f59-f6a1-4765-8218-ed1f88944b74 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:53.249971 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1b6a0f59-f6a1-4765-8218-ed1f88944b74 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:53.722423 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-1b6a0f59-f6a1-4765-8218-ed1f88944b74 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e637d319f449f38e4d6375ae5b22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c837e1766e0141ea9b868b89efee5ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:53.750715 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-1b6a0f59-f6a1-4765-8218-ed1f88944b74 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 200 len: 1315 microversion: 2.1 time: 0.539200 Oct 24 13:12:53.755298 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 19/32] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:53 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:54.349446 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-3980b542-4bb7-4b34-846d-e29ecab8114d req-672b612a-3434-41d7-84b5-78ecb35130ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d835cdc8-620a-46a9-83ce-d47557bf77a9", "tag": "2f3a03dc-1d36-4c18-8e1f-75cf0fb9c347"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:12:54.390355 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-3980b542-4bb7-4b34-846d-e29ecab8114d req-672b612a-3434-41d7-84b5-78ecb35130ae service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:54.399815 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-3980b542-4bb7-4b34-846d-e29ecab8114d req-672b612a-3434-41d7-84b5-78ecb35130ae service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:54.400549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-3980b542-4bb7-4b34-846d-e29ecab8114d req-672b612a-3434-41d7-84b5-78ecb35130ae service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:54.450400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-3980b542-4bb7-4b34-846d-e29ecab8114d req-672b612a-3434-41d7-84b5-78ecb35130ae service nova] Creating event network-changed:2f3a03dc-1d36-4c18-8e1f-75cf0fb9c347 for instance d835cdc8-620a-46a9-83ce-d47557bf77a9 on hv-cinder-86248 Oct 24 13:12:54.468142 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-3980b542-4bb7-4b34-846d-e29ecab8114d req-672b612a-3434-41d7-84b5-78ecb35130ae service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118914) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 13:12:54.469213 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-3980b542-4bb7-4b34-846d-e29ecab8114d req-672b612a-3434-41d7-84b5-78ecb35130ae service nova] Acquired lock "compute-rpcapi-router" {{(pid=118914) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 13:12:54.472601 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d14c3410-0a43-47a5-bfdd-0a78f4699a61 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:54.475017 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d14c3410-0a43-47a5-bfdd-0a78f4699a61 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:54.478110 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d14c3410-0a43-47a5-bfdd-0a78f4699a61 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:54.479846 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d14c3410-0a43-47a5-bfdd-0a78f4699a61 None None] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:54.480944 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d14c3410-0a43-47a5-bfdd-0a78f4699a61 None None] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:54.482466 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d14c3410-0a43-47a5-bfdd-0a78f4699a61 None None] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:54.508881 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.compute.rpcapi [None req-d14c3410-0a43-47a5-bfdd-0a78f4699a61 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 24 13:12:54.510234 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d14c3410-0a43-47a5-bfdd-0a78f4699a61 None None] Releasing lock "compute-rpcapi-router" {{(pid=118914) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 13:12:54.535566 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-d14c3410-0a43-47a5-bfdd-0a78f4699a61 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.778694 Oct 24 13:12:54.536386 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 20/33] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:12:54.541933 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-2447e9ee-65b7-4500-8690-9f3963f9e8df tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:54.542652 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-2447e9ee-65b7-4500-8690-9f3963f9e8df tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:54.549997 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2447e9ee-65b7-4500-8690-9f3963f9e8df tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:54.550511 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2447e9ee-65b7-4500-8690-9f3963f9e8df tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:54.550947 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2447e9ee-65b7-4500-8690-9f3963f9e8df tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:54.551683 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2447e9ee-65b7-4500-8690-9f3963f9e8df tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:54.552188 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2447e9ee-65b7-4500-8690-9f3963f9e8df tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:54.552612 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2447e9ee-65b7-4500-8690-9f3963f9e8df tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:54.745806 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-1fc403c4-235a-4b7a-897c-6ece4d5efcfc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Flavor limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:12:54.746946 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-1fc403c4-235a-4b7a-897c-6ece4d5efcfc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Image limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:12:54.747789 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-1fc403c4-235a-4b7a-897c-6ece4d5efcfc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Flavor pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:12:54.749720 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-1fc403c4-235a-4b7a-897c-6ece4d5efcfc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Image pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:12:54.750326 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-1fc403c4-235a-4b7a-897c-6ece4d5efcfc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:12:54.769838 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1fc403c4-235a-4b7a-897c-6ece4d5efcfc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:54.773603 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1fc403c4-235a-4b7a-897c-6ece4d5efcfc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:54.774339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1fc403c4-235a-4b7a-897c-6ece4d5efcfc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:54.775509 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1fc403c4-235a-4b7a-897c-6ece4d5efcfc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:54.777822 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1fc403c4-235a-4b7a-897c-6ece4d5efcfc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:54.782210 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1fc403c4-235a-4b7a-897c-6ece4d5efcfc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:54.819349 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-2447e9ee-65b7-4500-8690-9f3963f9e8df tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:54.832150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-1fc403c4-235a-4b7a-897c-6ece4d5efcfc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Getting quotas for project b736b09b6ee2492590cbc23db48752f4. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:12:54.844153 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-1fc403c4-235a-4b7a-897c-6ece4d5efcfc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Getting quotas for user 3e02f6f701324af6b53762569f1a9d21 and project b736b09b6ee2492590cbc23db48752f4. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:12:54.844486 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-2447e9ee-65b7-4500-8690-9f3963f9e8df tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1321 microversion: 2.1 time: 0.303216 Oct 24 13:12:54.874885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-1fc403c4-235a-4b7a-897c-6ece4d5efcfc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Going to run 1 instances... {{(pid=118915) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:12:54.879887 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-1fc403c4-235a-4b7a-897c-6ece4d5efcfc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4d2e5f3e-4aee-48d2-8ada-0b420d141f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:12:54.880077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 21/34] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:54 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1321 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:54.895319 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c6e90d83-543f-445b-81f6-488462ee6c4f tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:54.898657 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-c6e90d83-543f-445b-81f6-488462ee6c4f tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:54.919764 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c6e90d83-543f-445b-81f6-488462ee6c4f tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:54.920269 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c6e90d83-543f-445b-81f6-488462ee6c4f tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:54.921332 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c6e90d83-543f-445b-81f6-488462ee6c4f tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:54.922271 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c6e90d83-543f-445b-81f6-488462ee6c4f tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:54.922882 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c6e90d83-543f-445b-81f6-488462ee6c4f tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:54.923322 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c6e90d83-543f-445b-81f6-488462ee6c4f tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:54.995836 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-1fc403c4-235a-4b7a-897c-6ece4d5efcfc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 3.414006 Oct 24 13:12:55.004347 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 14/35] 10.222.0.42 () {62 vars in 1188 bytes} [Mon Oct 24 13:12:51 2022] POST /compute/v2.1/servers => generated 399 bytes in 3416 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 13:12:55.012161 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-64149223-a51f-4ed5-b5e3-375a2c30885c tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:55.013208 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-64149223-a51f-4ed5-b5e3-375a2c30885c tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:55.026034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-64149223-a51f-4ed5-b5e3-375a2c30885c tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:55.026888 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-64149223-a51f-4ed5-b5e3-375a2c30885c tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:55.027744 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-64149223-a51f-4ed5-b5e3-375a2c30885c tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:55.028918 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-64149223-a51f-4ed5-b5e3-375a2c30885c tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:55.029648 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-64149223-a51f-4ed5-b5e3-375a2c30885c tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:55.030865 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-64149223-a51f-4ed5-b5e3-375a2c30885c tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:55.070527 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-c6e90d83-543f-445b-81f6-488462ee6c4f tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:55.089263 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-c6e90d83-543f-445b-81f6-488462ee6c4f tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b" status: 200 len: 1294 microversion: 2.1 time: 0.206439 Oct 24 13:12:55.091438 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 22/36] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:54 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b => generated 1294 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:55.096522 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-cf67eff3-c641-4340-bf38-e32076e058aa tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:55.097481 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-cf67eff3-c641-4340-bf38-e32076e058aa tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:55.101474 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:55.164100 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-cf67eff3-c641-4340-bf38-e32076e058aa tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:55.180771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-cf67eff3-c641-4340-bf38-e32076e058aa tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:55.184794 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-cf67eff3-c641-4340-bf38-e32076e058aa tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:55.188312 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-cf67eff3-c641-4340-bf38-e32076e058aa tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1281 microversion: 2.20 time: 0.095670 Oct 24 13:12:55.191890 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 23/37] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:12:55 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1281 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:12:55.501442 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-36d27f5d-dc76-424f-9847-1b93ff88df8e req-783ad287-d2d9-4065-99cd-ffec083d261b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2011f5ea-73ab-457d-be16-25ad031e5e96", "tag": "1acef793-2d20-4fbe-8204-9955726c8836"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:12:55.519201 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-36d27f5d-dc76-424f-9847-1b93ff88df8e req-783ad287-d2d9-4065-99cd-ffec083d261b service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:55.519933 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-36d27f5d-dc76-424f-9847-1b93ff88df8e req-783ad287-d2d9-4065-99cd-ffec083d261b service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:55.520556 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-36d27f5d-dc76-424f-9847-1b93ff88df8e req-783ad287-d2d9-4065-99cd-ffec083d261b service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:55.542743 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-36d27f5d-dc76-424f-9847-1b93ff88df8e req-783ad287-d2d9-4065-99cd-ffec083d261b service nova] Creating event network-changed:1acef793-2d20-4fbe-8204-9955726c8836 for instance 2011f5ea-73ab-457d-be16-25ad031e5e96 on hv-cinder-86248 Oct 24 13:12:55.551242 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-36d27f5d-dc76-424f-9847-1b93ff88df8e req-783ad287-d2d9-4065-99cd-ffec083d261b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.340461 Oct 24 13:12:55.553637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 24/38] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:12:55.737794 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-64149223-a51f-4ed5-b5e3-375a2c30885c tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e637d319f449f38e4d6375ae5b22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c837e1766e0141ea9b868b89efee5ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:55.750826 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-64149223-a51f-4ed5-b5e3-375a2c30885c tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 200 len: 1315 microversion: 2.1 time: 0.743896 Oct 24 13:12:55.752524 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 15/39] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:55 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 1315 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:55.887715 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-785aa263-8963-43ef-afdf-eb9e5f0caffb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:55.890877 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-785aa263-8963-43ef-afdf-eb9e5f0caffb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:55.904560 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-785aa263-8963-43ef-afdf-eb9e5f0caffb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:55.905099 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-785aa263-8963-43ef-afdf-eb9e5f0caffb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:55.905540 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-785aa263-8963-43ef-afdf-eb9e5f0caffb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:55.906240 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-785aa263-8963-43ef-afdf-eb9e5f0caffb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:55.906692 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-785aa263-8963-43ef-afdf-eb9e5f0caffb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:55.907147 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-785aa263-8963-43ef-afdf-eb9e5f0caffb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:56.119168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-7137e11a-e238-468c-a7cb-f26384cd66c5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:56.119779 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-7137e11a-e238-468c-a7cb-f26384cd66c5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:56.132451 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7137e11a-e238-468c-a7cb-f26384cd66c5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:56.132945 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7137e11a-e238-468c-a7cb-f26384cd66c5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:56.133379 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7137e11a-e238-468c-a7cb-f26384cd66c5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:56.134070 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7137e11a-e238-468c-a7cb-f26384cd66c5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:56.134971 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7137e11a-e238-468c-a7cb-f26384cd66c5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:56.135413 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7137e11a-e238-468c-a7cb-f26384cd66c5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:56.153511 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-785aa263-8963-43ef-afdf-eb9e5f0caffb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:56.169525 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-785aa263-8963-43ef-afdf-eb9e5f0caffb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1321 microversion: 2.1 time: 0.294486 Oct 24 13:12:56.170474 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 25/40] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:55 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:56.221000 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-294de33d-f95c-4ce3-bca4-9148233e71d9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:56.222331 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-294de33d-f95c-4ce3-bca4-9148233e71d9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:56.232598 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-294de33d-f95c-4ce3-bca4-9148233e71d9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:56.234352 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-294de33d-f95c-4ce3-bca4-9148233e71d9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:56.234666 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-7137e11a-e238-468c-a7cb-f26384cd66c5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:56.235416 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-294de33d-f95c-4ce3-bca4-9148233e71d9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:56.238658 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-294de33d-f95c-4ce3-bca4-9148233e71d9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:56.239252 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-294de33d-f95c-4ce3-bca4-9148233e71d9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:56.239748 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-294de33d-f95c-4ce3-bca4-9148233e71d9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:56.251292 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-7137e11a-e238-468c-a7cb-f26384cd66c5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b" status: 200 len: 1312 microversion: 2.1 time: 0.136582 Oct 24 13:12:56.252587 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 16/41] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:56 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b => generated 1312 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:12:56.317610 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-294de33d-f95c-4ce3-bca4-9148233e71d9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:56.325840 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-294de33d-f95c-4ce3-bca4-9148233e71d9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:56.328090 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-294de33d-f95c-4ce3-bca4-9148233e71d9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:56.329203 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-294de33d-f95c-4ce3-bca4-9148233e71d9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1285 microversion: 2.20 time: 0.113195 Oct 24 13:12:56.329925 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 26/42] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:12:56 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:12:56.783157 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-488d7014-c38e-4f20-a772-dbce6086a7c4 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:56.783912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-488d7014-c38e-4f20-a772-dbce6086a7c4 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:56.798548 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-488d7014-c38e-4f20-a772-dbce6086a7c4 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:56.799227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-488d7014-c38e-4f20-a772-dbce6086a7c4 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:56.799683 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-488d7014-c38e-4f20-a772-dbce6086a7c4 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:56.800402 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-488d7014-c38e-4f20-a772-dbce6086a7c4 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:56.800867 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-488d7014-c38e-4f20-a772-dbce6086a7c4 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:56.801298 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-488d7014-c38e-4f20-a772-dbce6086a7c4 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:57.196962 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d683896a-4c7b-4022-9d02-eb46c2a3ff2e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:57.197932 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-d683896a-4c7b-4022-9d02-eb46c2a3ff2e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:57.212133 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d683896a-4c7b-4022-9d02-eb46c2a3ff2e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:57.215712 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d683896a-4c7b-4022-9d02-eb46c2a3ff2e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:57.217004 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d683896a-4c7b-4022-9d02-eb46c2a3ff2e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:57.220097 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d683896a-4c7b-4022-9d02-eb46c2a3ff2e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:57.222968 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d683896a-4c7b-4022-9d02-eb46c2a3ff2e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:57.225432 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d683896a-4c7b-4022-9d02-eb46c2a3ff2e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:57.516077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-488d7014-c38e-4f20-a772-dbce6086a7c4 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e637d319f449f38e4d6375ae5b22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c837e1766e0141ea9b868b89efee5ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:57.539379 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-488d7014-c38e-4f20-a772-dbce6086a7c4 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 200 len: 1315 microversion: 2.1 time: 0.760902 Oct 24 13:12:57.542015 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 17/43] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:56 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 1315 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:57.557382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-04eb3d02-f700-461c-9858-210bab919de4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:57.557943 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-04eb3d02-f700-461c-9858-210bab919de4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:57.570699 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-04eb3d02-f700-461c-9858-210bab919de4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:57.571275 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-04eb3d02-f700-461c-9858-210bab919de4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:57.574927 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-04eb3d02-f700-461c-9858-210bab919de4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:57.578237 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-04eb3d02-f700-461c-9858-210bab919de4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:57.578755 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-04eb3d02-f700-461c-9858-210bab919de4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:57.583330 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-04eb3d02-f700-461c-9858-210bab919de4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:57.736626 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-d683896a-4c7b-4022-9d02-eb46c2a3ff2e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:57.747723 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-d683896a-4c7b-4022-9d02-eb46c2a3ff2e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1321 microversion: 2.1 time: 0.558315 Oct 24 13:12:57.752815 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 27/44] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:57 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1321 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:57.765811 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-04eb3d02-f700-461c-9858-210bab919de4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:57.778085 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-cbd61662-db3d-4c52-b5ff-fab6ff3a1104 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:57.779040 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-cbd61662-db3d-4c52-b5ff-fab6ff3a1104 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:57.783294 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-04eb3d02-f700-461c-9858-210bab919de4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b" status: 200 len: 1300 microversion: 2.1 time: 0.237054 Oct 24 13:12:57.793100 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 18/45] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:57 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b => generated 1300 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:57.793899 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cbd61662-db3d-4c52-b5ff-fab6ff3a1104 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:57.794497 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cbd61662-db3d-4c52-b5ff-fab6ff3a1104 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:57.795034 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cbd61662-db3d-4c52-b5ff-fab6ff3a1104 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:57.796371 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cbd61662-db3d-4c52-b5ff-fab6ff3a1104 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:57.796944 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cbd61662-db3d-4c52-b5ff-fab6ff3a1104 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:57.797579 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cbd61662-db3d-4c52-b5ff-fab6ff3a1104 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:57.799245 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-6ee9ad60-3c07-4fb8-a46b-ac09b0df936b req-08efff55-0d7e-461d-80e9-8c42aebc5d7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aac99c2-2d97-41c4-b44c-629b52631804", "tag": "763cd320-528d-4a92-b74f-cd47217f446b"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:12:57.826591 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-6ee9ad60-3c07-4fb8-a46b-ac09b0df936b req-08efff55-0d7e-461d-80e9-8c42aebc5d7c service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:57.827943 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-6ee9ad60-3c07-4fb8-a46b-ac09b0df936b req-08efff55-0d7e-461d-80e9-8c42aebc5d7c service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:57.828397 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-6ee9ad60-3c07-4fb8-a46b-ac09b0df936b req-08efff55-0d7e-461d-80e9-8c42aebc5d7c service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:57.870862 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-6ee9ad60-3c07-4fb8-a46b-ac09b0df936b req-08efff55-0d7e-461d-80e9-8c42aebc5d7c service nova] Creating event network-changed:763cd320-528d-4a92-b74f-cd47217f446b for instance 6aac99c2-2d97-41c4-b44c-629b52631804 on hv-cinder-86248 Oct 24 13:12:57.871421 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-6ee9ad60-3c07-4fb8-a46b-ac09b0df936b req-08efff55-0d7e-461d-80e9-8c42aebc5d7c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118915) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 24 13:12:57.879540 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-6ee9ad60-3c07-4fb8-a46b-ac09b0df936b req-08efff55-0d7e-461d-80e9-8c42aebc5d7c service nova] Acquired lock "compute-rpcapi-router" {{(pid=118915) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 24 13:12:57.880797 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-83118a9e-8c00-44ac-911b-11c26c9a8f83 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:57.885425 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-83118a9e-8c00-44ac-911b-11c26c9a8f83 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:57.886046 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-83118a9e-8c00-44ac-911b-11c26c9a8f83 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:57.887566 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-83118a9e-8c00-44ac-911b-11c26c9a8f83 None None] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:57.888173 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-83118a9e-8c00-44ac-911b-11c26c9a8f83 None None] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:57.888743 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-83118a9e-8c00-44ac-911b-11c26c9a8f83 None None] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:57.900042 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.compute.rpcapi [None req-83118a9e-8c00-44ac-911b-11c26c9a8f83 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 24 13:12:57.901166 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-83118a9e-8c00-44ac-911b-11c26c9a8f83 None None] Releasing lock "compute-rpcapi-router" {{(pid=118915) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 24 13:12:57.921682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-83118a9e-8c00-44ac-911b-11c26c9a8f83 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126720 Oct 24 13:12:57.923045 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 19/46] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:12:57.972100 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-cbd61662-db3d-4c52-b5ff-fab6ff3a1104 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:57.982365 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-cbd61662-db3d-4c52-b5ff-fab6ff3a1104 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:57.985067 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-cbd61662-db3d-4c52-b5ff-fab6ff3a1104 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:57.986882 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-cbd61662-db3d-4c52-b5ff-fab6ff3a1104 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1341 microversion: 2.20 time: 0.232573 Oct 24 13:12:57.988003 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 28/47] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:12:57 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1341 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:12:58.568884 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-e6d28327-95de-49a8-9ee2-c672defc973e tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:58.569865 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-e6d28327-95de-49a8-9ee2-c672defc973e tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:58.584759 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e6d28327-95de-49a8-9ee2-c672defc973e tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:58.585465 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e6d28327-95de-49a8-9ee2-c672defc973e tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:58.586137 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e6d28327-95de-49a8-9ee2-c672defc973e tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:58.587244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e6d28327-95de-49a8-9ee2-c672defc973e tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:58.588790 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e6d28327-95de-49a8-9ee2-c672defc973e tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:58.589423 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e6d28327-95de-49a8-9ee2-c672defc973e tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:58.779373 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a742d03a-f813-4037-a5ba-c173df6769d7 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:58.780329 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a742d03a-f813-4037-a5ba-c173df6769d7 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:58.797382 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a742d03a-f813-4037-a5ba-c173df6769d7 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:58.800852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a742d03a-f813-4037-a5ba-c173df6769d7 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:58.801538 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a742d03a-f813-4037-a5ba-c173df6769d7 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:58.803581 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a742d03a-f813-4037-a5ba-c173df6769d7 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:58.806625 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a742d03a-f813-4037-a5ba-c173df6769d7 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:58.807528 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a742d03a-f813-4037-a5ba-c173df6769d7 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:59.098185 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a742d03a-f813-4037-a5ba-c173df6769d7 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:59.100409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-e6d28327-95de-49a8-9ee2-c672defc973e tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e637d319f449f38e4d6375ae5b22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c837e1766e0141ea9b868b89efee5ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:59.106729 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a742d03a-f813-4037-a5ba-c173df6769d7 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1321 microversion: 2.1 time: 0.332590 Oct 24 13:12:59.110721 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 29/48] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:58 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1321 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:12:59.117718 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-e6d28327-95de-49a8-9ee2-c672defc973e tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 200 len: 1315 microversion: 2.1 time: 0.554534 Oct 24 13:12:59.124473 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 20/49] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:58 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:12:59.131664 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-79436e3c-d4eb-46d8-b974-454f69359aa5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:59.132123 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-3d12426e-64ce-412a-8dc9-8f3058068538 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:12:59.133108 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-3d12426e-64ce-412a-8dc9-8f3058068538 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:59.137041 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-79436e3c-d4eb-46d8-b974-454f69359aa5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:12:59.143668 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3d12426e-64ce-412a-8dc9-8f3058068538 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:59.144544 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3d12426e-64ce-412a-8dc9-8f3058068538 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:59.145154 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3d12426e-64ce-412a-8dc9-8f3058068538 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:59.149636 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79436e3c-d4eb-46d8-b974-454f69359aa5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:59.149636 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79436e3c-d4eb-46d8-b974-454f69359aa5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:59.149636 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79436e3c-d4eb-46d8-b974-454f69359aa5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:59.150332 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79436e3c-d4eb-46d8-b974-454f69359aa5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:59.151607 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79436e3c-d4eb-46d8-b974-454f69359aa5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:59.151930 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3d12426e-64ce-412a-8dc9-8f3058068538 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:12:59.152174 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79436e3c-d4eb-46d8-b974-454f69359aa5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:59.152688 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3d12426e-64ce-412a-8dc9-8f3058068538 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:12:59.153401 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3d12426e-64ce-412a-8dc9-8f3058068538 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:12:59.186864 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=100 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:12:59.802724 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-79436e3c-d4eb-46d8-b974-454f69359aa5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:59.814925 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-79436e3c-d4eb-46d8-b974-454f69359aa5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:59.816466 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-79436e3c-d4eb-46d8-b974-454f69359aa5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:12:59.822582 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-79436e3c-d4eb-46d8-b974-454f69359aa5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1339 microversion: 2.20 time: 0.694296 Oct 24 13:12:59.824417 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 21/50] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:12:59 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1339 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:12:59.985234 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-3d12426e-64ce-412a-8dc9-8f3058068538 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:00.000423 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-3d12426e-64ce-412a-8dc9-8f3058068538 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b" status: 200 len: 1367 microversion: 2.1 time: 0.888552 Oct 24 13:13:00.022912 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 30/51] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:12:59 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b => generated 1367 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:00.129770 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-e2234d5d-bdb7-44bd-b1a4-01eb7dd9d8d4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:00.130369 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-e2234d5d-bdb7-44bd-b1a4-01eb7dd9d8d4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:00.149815 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e2234d5d-bdb7-44bd-b1a4-01eb7dd9d8d4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:00.152287 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e2234d5d-bdb7-44bd-b1a4-01eb7dd9d8d4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:00.153107 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e2234d5d-bdb7-44bd-b1a4-01eb7dd9d8d4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:00.153552 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-da113900-a86a-46ee-b1fb-470f040ee8c1 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:00.154229 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e2234d5d-bdb7-44bd-b1a4-01eb7dd9d8d4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:00.154390 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-da113900-a86a-46ee-b1fb-470f040ee8c1 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:00.156261 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e2234d5d-bdb7-44bd-b1a4-01eb7dd9d8d4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:00.157338 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e2234d5d-bdb7-44bd-b1a4-01eb7dd9d8d4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:00.168716 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-da113900-a86a-46ee-b1fb-470f040ee8c1 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:00.169134 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-da113900-a86a-46ee-b1fb-470f040ee8c1 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:00.169554 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-da113900-a86a-46ee-b1fb-470f040ee8c1 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:00.170266 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-da113900-a86a-46ee-b1fb-470f040ee8c1 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:00.170853 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-da113900-a86a-46ee-b1fb-470f040ee8c1 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:00.171191 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-da113900-a86a-46ee-b1fb-470f040ee8c1 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:00.502828 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-da113900-a86a-46ee-b1fb-470f040ee8c1 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e637d319f449f38e4d6375ae5b22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c837e1766e0141ea9b868b89efee5ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:00.522053 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-da113900-a86a-46ee-b1fb-470f040ee8c1 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 200 len: 1315 microversion: 2.1 time: 0.371306 Oct 24 13:13:00.526515 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 31/52] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:00 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:00.897919 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-5188eb7d-a42e-4ae4-ae1b-0ee5f2d64db7 req-02fa256a-cc3e-45bb-8be5-803e5f68307b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d835cdc8-620a-46a9-83ce-d47557bf77a9", "name": "network-vif-plugged", "status": "completed", "tag": "2f3a03dc-1d36-4c18-8e1f-75cf0fb9c347"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:13:00.925764 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-5188eb7d-a42e-4ae4-ae1b-0ee5f2d64db7 req-02fa256a-cc3e-45bb-8be5-803e5f68307b service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:00.926258 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-5188eb7d-a42e-4ae4-ae1b-0ee5f2d64db7 req-02fa256a-cc3e-45bb-8be5-803e5f68307b service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:00.926691 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-5188eb7d-a42e-4ae4-ae1b-0ee5f2d64db7 req-02fa256a-cc3e-45bb-8be5-803e5f68307b service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:00.954001 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-5188eb7d-a42e-4ae4-ae1b-0ee5f2d64db7 req-02fa256a-cc3e-45bb-8be5-803e5f68307b service nova] Creating event network-vif-plugged:2f3a03dc-1d36-4c18-8e1f-75cf0fb9c347 for instance d835cdc8-620a-46a9-83ce-d47557bf77a9 on hv-cinder-86248 Oct 24 13:13:00.967672 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-5188eb7d-a42e-4ae4-ae1b-0ee5f2d64db7 req-02fa256a-cc3e-45bb-8be5-803e5f68307b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215475 Oct 24 13:13:00.971438 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 32/53] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:13:00.981999 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-e3d76f00-01d6-4875-8799-549a6ff412a7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:00.985958 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-e3d76f00-01d6-4875-8799-549a6ff412a7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:01.027373 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e3d76f00-01d6-4875-8799-549a6ff412a7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:01.027877 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e3d76f00-01d6-4875-8799-549a6ff412a7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:01.028318 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e3d76f00-01d6-4875-8799-549a6ff412a7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:01.029030 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e3d76f00-01d6-4875-8799-549a6ff412a7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:01.029489 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e3d76f00-01d6-4875-8799-549a6ff412a7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:01.030788 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e3d76f00-01d6-4875-8799-549a6ff412a7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:01.196065 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-e2234d5d-bdb7-44bd-b1a4-01eb7dd9d8d4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:01.207692 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-e2234d5d-bdb7-44bd-b1a4-01eb7dd9d8d4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1321 microversion: 2.1 time: 1.081700 Oct 24 13:13:01.208286 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 22/54] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:00 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1321 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:01.235577 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-98932c7a-4335-450d-b56f-28fc96b4899c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:01.236202 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-98932c7a-4335-450d-b56f-28fc96b4899c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:01.257551 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-98932c7a-4335-450d-b56f-28fc96b4899c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:01.258422 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-98932c7a-4335-450d-b56f-28fc96b4899c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:01.258868 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-98932c7a-4335-450d-b56f-28fc96b4899c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:01.259606 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-98932c7a-4335-450d-b56f-28fc96b4899c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:01.262578 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-98932c7a-4335-450d-b56f-28fc96b4899c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:01.264288 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-98932c7a-4335-450d-b56f-28fc96b4899c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:01.347853 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-e3d76f00-01d6-4875-8799-549a6ff412a7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:01.362846 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-e3d76f00-01d6-4875-8799-549a6ff412a7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:01.365595 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-e3d76f00-01d6-4875-8799-549a6ff412a7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:01.367310 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-e3d76f00-01d6-4875-8799-549a6ff412a7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1339 microversion: 2.20 time: 0.394261 Oct 24 13:13:01.368477 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 33/55] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:13:00 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1339 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:13:01.547481 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-dfd9f4f5-2b3f-4654-a729-bc5f4e44ec53 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:01.548418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-dfd9f4f5-2b3f-4654-a729-bc5f4e44ec53 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:01.589354 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dfd9f4f5-2b3f-4654-a729-bc5f4e44ec53 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:01.593575 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dfd9f4f5-2b3f-4654-a729-bc5f4e44ec53 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:01.595575 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dfd9f4f5-2b3f-4654-a729-bc5f4e44ec53 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:01.599968 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dfd9f4f5-2b3f-4654-a729-bc5f4e44ec53 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:01.601590 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dfd9f4f5-2b3f-4654-a729-bc5f4e44ec53 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:01.602668 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dfd9f4f5-2b3f-4654-a729-bc5f4e44ec53 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:01.672137 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-98932c7a-4335-450d-b56f-28fc96b4899c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:01.689981 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-98932c7a-4335-450d-b56f-28fc96b4899c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b" status: 200 len: 1367 microversion: 2.1 time: 0.462834 Oct 24 13:13:01.695318 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 23/56] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:01 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b => generated 1367 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:01.705090 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-a90c58be-b1bc-4fd4-a8b8-b9de4ae50f07 req-a8195b03-d976-421c-a689-1af2ab8ccd45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0d11b9d-5ddc-4747-9632-d652e6c93b7b", "tag": "3279f147-249f-4187-bbc4-6ce7f6ef81c1"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:13:01.729107 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:01.745063 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-a90c58be-b1bc-4fd4-a8b8-b9de4ae50f07 req-a8195b03-d976-421c-a689-1af2ab8ccd45 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:01.747623 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-a90c58be-b1bc-4fd4-a8b8-b9de4ae50f07 req-a8195b03-d976-421c-a689-1af2ab8ccd45 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:01.748314 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-a90c58be-b1bc-4fd4-a8b8-b9de4ae50f07 req-a8195b03-d976-421c-a689-1af2ab8ccd45 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:01.795426 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=93 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:01.798129 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-a90c58be-b1bc-4fd4-a8b8-b9de4ae50f07 req-a8195b03-d976-421c-a689-1af2ab8ccd45 service nova] Creating event network-changed:3279f147-249f-4187-bbc4-6ce7f6ef81c1 for instance b0d11b9d-5ddc-4747-9632-d652e6c93b7b on hv-cinder-86248 Oct 24 13:13:01.812070 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-a90c58be-b1bc-4fd4-a8b8-b9de4ae50f07 req-a8195b03-d976-421c-a689-1af2ab8ccd45 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112967 Oct 24 13:13:01.814762 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 24/57] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:13:02.004806 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-dfd9f4f5-2b3f-4654-a729-bc5f4e44ec53 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e637d319f449f38e4d6375ae5b22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c837e1766e0141ea9b868b89efee5ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:02.017174 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-dfd9f4f5-2b3f-4654-a729-bc5f4e44ec53 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 200 len: 1315 microversion: 2.1 time: 0.475391 Oct 24 13:13:02.018561 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 34/58] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:01 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:02.250387 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-5fb9a433-d360-4ea5-b0c9-9a8cb5ca3bf5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:02.251994 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-5fb9a433-d360-4ea5-b0c9-9a8cb5ca3bf5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:02.261392 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5fb9a433-d360-4ea5-b0c9-9a8cb5ca3bf5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:02.262096 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5fb9a433-d360-4ea5-b0c9-9a8cb5ca3bf5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:02.262734 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5fb9a433-d360-4ea5-b0c9-9a8cb5ca3bf5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:02.263707 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5fb9a433-d360-4ea5-b0c9-9a8cb5ca3bf5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:02.264386 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5fb9a433-d360-4ea5-b0c9-9a8cb5ca3bf5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:02.265073 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5fb9a433-d360-4ea5-b0c9-9a8cb5ca3bf5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:02.395568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-eb1ee374-405a-428e-844f-72bfa4b455e9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:02.396835 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-eb1ee374-405a-428e-844f-72bfa4b455e9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:02.416211 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-eb1ee374-405a-428e-844f-72bfa4b455e9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:02.417113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-eb1ee374-405a-428e-844f-72bfa4b455e9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:02.418413 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-eb1ee374-405a-428e-844f-72bfa4b455e9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:02.432643 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-eb1ee374-405a-428e-844f-72bfa4b455e9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:02.438972 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-eb1ee374-405a-428e-844f-72bfa4b455e9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:02.440998 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-eb1ee374-405a-428e-844f-72bfa4b455e9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:02.742762 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-5fb9a433-d360-4ea5-b0c9-9a8cb5ca3bf5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:02.767246 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-5fb9a433-d360-4ea5-b0c9-9a8cb5ca3bf5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1321 microversion: 2.1 time: 0.521067 Oct 24 13:13:02.773657 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 25/59] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:02 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1321 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:02.804426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-eb1ee374-405a-428e-844f-72bfa4b455e9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:02.813922 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-eb1ee374-405a-428e-844f-72bfa4b455e9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:02.815405 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-eb1ee374-405a-428e-844f-72bfa4b455e9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:02.818137 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-6c5fec62-9099-47ac-8776-106cadb47f85 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:02.818840 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-6c5fec62-9099-47ac-8776-106cadb47f85 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:02.824975 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-eb1ee374-405a-428e-844f-72bfa4b455e9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1404 microversion: 2.20 time: 0.426309 Oct 24 13:13:02.826128 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 35/60] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:13:02 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1404 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:13:02.850621 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6c5fec62-9099-47ac-8776-106cadb47f85 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:02.853505 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6c5fec62-9099-47ac-8776-106cadb47f85 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:02.854209 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6c5fec62-9099-47ac-8776-106cadb47f85 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:02.854942 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6c5fec62-9099-47ac-8776-106cadb47f85 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:02.855428 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6c5fec62-9099-47ac-8776-106cadb47f85 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:02.864519 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6c5fec62-9099-47ac-8776-106cadb47f85 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:03.010055 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-c4c46dc6-f4db-465d-8884-85496c7e6d75 req-bcf90997-b0f0-4ca2-9c3a-688e4fde8a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2011f5ea-73ab-457d-be16-25ad031e5e96", "name": "network-vif-plugged", "status": "completed", "tag": "1acef793-2d20-4fbe-8204-9955726c8836"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:13:03.030935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-c4c46dc6-f4db-465d-8884-85496c7e6d75 req-bcf90997-b0f0-4ca2-9c3a-688e4fde8a48 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:03.031992 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-c4c46dc6-f4db-465d-8884-85496c7e6d75 req-bcf90997-b0f0-4ca2-9c3a-688e4fde8a48 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:03.032575 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-c4c46dc6-f4db-465d-8884-85496c7e6d75 req-bcf90997-b0f0-4ca2-9c3a-688e4fde8a48 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:03.065522 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-c4c46dc6-f4db-465d-8884-85496c7e6d75 req-bcf90997-b0f0-4ca2-9c3a-688e4fde8a48 service nova] Creating event network-vif-plugged:1acef793-2d20-4fbe-8204-9955726c8836 for instance 2011f5ea-73ab-457d-be16-25ad031e5e96 on hv-cinder-86248 Oct 24 13:13:03.071364 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-c4c46dc6-f4db-465d-8884-85496c7e6d75 req-bcf90997-b0f0-4ca2-9c3a-688e4fde8a48 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065813 Oct 24 13:13:03.072543 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 36/61] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:13:03.081064 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-99b5da2d-f114-4a70-9885-dd5af095d80a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:03.082282 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-99b5da2d-f114-4a70-9885-dd5af095d80a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:03.098848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-99b5da2d-f114-4a70-9885-dd5af095d80a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:03.099692 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-99b5da2d-f114-4a70-9885-dd5af095d80a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:03.101144 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-99b5da2d-f114-4a70-9885-dd5af095d80a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:03.103413 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-99b5da2d-f114-4a70-9885-dd5af095d80a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:03.105038 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-99b5da2d-f114-4a70-9885-dd5af095d80a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:03.105552 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-99b5da2d-f114-4a70-9885-dd5af095d80a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:03.240654 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-6c5fec62-9099-47ac-8776-106cadb47f85 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:03.253794 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-6c5fec62-9099-47ac-8776-106cadb47f85 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b" status: 200 len: 1367 microversion: 2.1 time: 0.477672 Oct 24 13:13:03.254377 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 26/62] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:02 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b => generated 1367 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:03.337206 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-99b5da2d-f114-4a70-9885-dd5af095d80a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e637d319f449f38e4d6375ae5b22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c837e1766e0141ea9b868b89efee5ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:03.347623 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-99b5da2d-f114-4a70-9885-dd5af095d80a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 200 len: 1315 microversion: 2.1 time: 0.273565 Oct 24 13:13:03.348383 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 37/63] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:03 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:03.798515 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-f6f73339-9478-4e0e-b4ad-2e6fab922688 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:03.799312 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-f6f73339-9478-4e0e-b4ad-2e6fab922688 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:03.808056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f6f73339-9478-4e0e-b4ad-2e6fab922688 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:03.812985 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f6f73339-9478-4e0e-b4ad-2e6fab922688 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:03.814351 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f6f73339-9478-4e0e-b4ad-2e6fab922688 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:03.815352 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f6f73339-9478-4e0e-b4ad-2e6fab922688 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:03.818544 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f6f73339-9478-4e0e-b4ad-2e6fab922688 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:03.819827 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f6f73339-9478-4e0e-b4ad-2e6fab922688 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:03.856234 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-8eec4606-12f8-4995-ae52-84a48fc1352c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:03.857887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-8eec4606-12f8-4995-ae52-84a48fc1352c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:03.872438 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8eec4606-12f8-4995-ae52-84a48fc1352c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:03.874640 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8eec4606-12f8-4995-ae52-84a48fc1352c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:03.879174 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8eec4606-12f8-4995-ae52-84a48fc1352c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:03.881564 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8eec4606-12f8-4995-ae52-84a48fc1352c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:03.884274 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8eec4606-12f8-4995-ae52-84a48fc1352c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:03.886687 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8eec4606-12f8-4995-ae52-84a48fc1352c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:04.174951 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-8eec4606-12f8-4995-ae52-84a48fc1352c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:04.186500 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-8eec4606-12f8-4995-ae52-84a48fc1352c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:04.188037 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-8eec4606-12f8-4995-ae52-84a48fc1352c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:04.189451 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-8eec4606-12f8-4995-ae52-84a48fc1352c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1404 microversion: 2.20 time: 0.337170 Oct 24 13:13:04.190273 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 38/64] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:13:03 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1404 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:13:04.209262 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-f6f73339-9478-4e0e-b4ad-2e6fab922688 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:04.219464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-f6f73339-9478-4e0e-b4ad-2e6fab922688 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1321 microversion: 2.1 time: 0.426260 Oct 24 13:13:04.220844 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 27/65] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:03 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1321 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:04.279128 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-6b5478af-df46-4413-86ca-5a140aea24c9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:04.279316 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-fb97b002-f1d6-443a-95bc-6bb8f9858485 req-ed000b87-b392-4ef0-8bbd-c849cf060ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27b5963f-5199-4822-a8c3-20a8ab09224f", "tag": "9241fec5-c702-4043-a917-794ed6ca4105"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:13:04.292741 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-6b5478af-df46-4413-86ca-5a140aea24c9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:04.301917 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-fb97b002-f1d6-443a-95bc-6bb8f9858485 req-ed000b87-b392-4ef0-8bbd-c849cf060ca7 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:04.302612 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-fb97b002-f1d6-443a-95bc-6bb8f9858485 req-ed000b87-b392-4ef0-8bbd-c849cf060ca7 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:04.303181 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-fb97b002-f1d6-443a-95bc-6bb8f9858485 req-ed000b87-b392-4ef0-8bbd-c849cf060ca7 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:04.310770 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6b5478af-df46-4413-86ca-5a140aea24c9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:04.312057 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6b5478af-df46-4413-86ca-5a140aea24c9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:04.312703 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6b5478af-df46-4413-86ca-5a140aea24c9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:04.315359 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6b5478af-df46-4413-86ca-5a140aea24c9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:04.316037 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6b5478af-df46-4413-86ca-5a140aea24c9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:04.316650 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6b5478af-df46-4413-86ca-5a140aea24c9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:04.318170 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-fb97b002-f1d6-443a-95bc-6bb8f9858485 req-ed000b87-b392-4ef0-8bbd-c849cf060ca7 service nova] Creating event network-changed:9241fec5-c702-4043-a917-794ed6ca4105 for instance 27b5963f-5199-4822-a8c3-20a8ab09224f on hv-cinder-86248 Oct 24 13:13:04.323979 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-fb97b002-f1d6-443a-95bc-6bb8f9858485 req-ed000b87-b392-4ef0-8bbd-c849cf060ca7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048342 Oct 24 13:13:04.325217 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 28/66] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:13:04.383095 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-0c285e8b-bd98-4bc4-ad5f-62193566a59d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:04.385624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-0c285e8b-bd98-4bc4-ad5f-62193566a59d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:04.393223 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0c285e8b-bd98-4bc4-ad5f-62193566a59d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:04.393725 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0c285e8b-bd98-4bc4-ad5f-62193566a59d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:04.394297 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0c285e8b-bd98-4bc4-ad5f-62193566a59d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:04.395299 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0c285e8b-bd98-4bc4-ad5f-62193566a59d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:04.396046 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0c285e8b-bd98-4bc4-ad5f-62193566a59d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:04.396465 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0c285e8b-bd98-4bc4-ad5f-62193566a59d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:04.502692 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=4 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:04.549477 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-6b5478af-df46-4413-86ca-5a140aea24c9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:04.560719 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-6b5478af-df46-4413-86ca-5a140aea24c9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b" status: 200 len: 1367 microversion: 2.1 time: 0.286620 Oct 24 13:13:04.563136 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 39/67] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:04 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:04.618695 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-0c285e8b-bd98-4bc4-ad5f-62193566a59d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e637d319f449f38e4d6375ae5b22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c837e1766e0141ea9b868b89efee5ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:04.628421 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-0c285e8b-bd98-4bc4-ad5f-62193566a59d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 200 len: 1503 microversion: 2.1 time: 0.251467 Oct 24 13:13:04.635679 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 29/68] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:04 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 1503 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:13:05.088019 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-9bf57b6b-31d6-4a47-95e7-0031f12c0c49 req-d595c835-0f82-4e49-9b43-f924c43e9224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aac99c2-2d97-41c4-b44c-629b52631804", "name": "network-vif-plugged", "status": "completed", "tag": "763cd320-528d-4a92-b74f-cd47217f446b"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:13:05.098604 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-9bf57b6b-31d6-4a47-95e7-0031f12c0c49 req-d595c835-0f82-4e49-9b43-f924c43e9224 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:05.099104 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-9bf57b6b-31d6-4a47-95e7-0031f12c0c49 req-d595c835-0f82-4e49-9b43-f924c43e9224 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:05.099685 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-9bf57b6b-31d6-4a47-95e7-0031f12c0c49 req-d595c835-0f82-4e49-9b43-f924c43e9224 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:05.111514 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-9bf57b6b-31d6-4a47-95e7-0031f12c0c49 req-d595c835-0f82-4e49-9b43-f924c43e9224 service nova] Creating event network-vif-plugged:763cd320-528d-4a92-b74f-cd47217f446b for instance 6aac99c2-2d97-41c4-b44c-629b52631804 on hv-cinder-86248 Oct 24 13:13:05.116318 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-9bf57b6b-31d6-4a47-95e7-0031f12c0c49 req-d595c835-0f82-4e49-9b43-f924c43e9224 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031891 Oct 24 13:13:05.116911 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 40/69] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:13:05.218733 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-ea6c00a3-66df-42a8-93f2-8134199a52e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:05.219313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-ea6c00a3-66df-42a8-93f2-8134199a52e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:05.221319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=6 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:05.226722 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ea6c00a3-66df-42a8-93f2-8134199a52e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:05.227239 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ea6c00a3-66df-42a8-93f2-8134199a52e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:05.227673 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ea6c00a3-66df-42a8-93f2-8134199a52e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:05.228359 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ea6c00a3-66df-42a8-93f2-8134199a52e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:05.228843 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ea6c00a3-66df-42a8-93f2-8134199a52e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:05.229262 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ea6c00a3-66df-42a8-93f2-8134199a52e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:05.241921 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=10 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:05.248104 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-34bbfaa2-17b0-4392-a4c2-48426c36c84f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:05.248846 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-34bbfaa2-17b0-4392-a4c2-48426c36c84f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:05.256938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-34bbfaa2-17b0-4392-a4c2-48426c36c84f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:05.257432 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-34bbfaa2-17b0-4392-a4c2-48426c36c84f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:05.257868 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-34bbfaa2-17b0-4392-a4c2-48426c36c84f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:05.258685 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-34bbfaa2-17b0-4392-a4c2-48426c36c84f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:05.259241 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-34bbfaa2-17b0-4392-a4c2-48426c36c84f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:05.260304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-34bbfaa2-17b0-4392-a4c2-48426c36c84f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:05.381039 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-ea6c00a3-66df-42a8-93f2-8134199a52e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:05.390940 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-ea6c00a3-66df-42a8-93f2-8134199a52e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:05.392709 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-ea6c00a3-66df-42a8-93f2-8134199a52e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:05.394131 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-ea6c00a3-66df-42a8-93f2-8134199a52e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1404 microversion: 2.20 time: 0.181669 Oct 24 13:13:05.405288 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-34bbfaa2-17b0-4392-a4c2-48426c36c84f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:05.407382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 30/70] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:13:05 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1404 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:13:05.413662 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-34bbfaa2-17b0-4392-a4c2-48426c36c84f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1321 microversion: 2.1 time: 0.172615 Oct 24 13:13:05.414250 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 41/71] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:05 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:13:05.586247 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-277e1f0e-4faa-486c-af79-6c0d72598b21 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:05.586915 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-277e1f0e-4faa-486c-af79-6c0d72598b21 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:05.595926 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-277e1f0e-4faa-486c-af79-6c0d72598b21 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:05.596465 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-277e1f0e-4faa-486c-af79-6c0d72598b21 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:05.596857 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-277e1f0e-4faa-486c-af79-6c0d72598b21 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:05.597564 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-277e1f0e-4faa-486c-af79-6c0d72598b21 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:05.598021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-277e1f0e-4faa-486c-af79-6c0d72598b21 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:05.598447 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-277e1f0e-4faa-486c-af79-6c0d72598b21 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:05.744108 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-277e1f0e-4faa-486c-af79-6c0d72598b21 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:05.754160 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-277e1f0e-4faa-486c-af79-6c0d72598b21 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b" status: 200 len: 1367 microversion: 2.1 time: 0.172024 Oct 24 13:13:05.755451 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 31/72] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:05 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:06.421723 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-ba6db0aa-7ccb-476b-8fd2-f4ec49186a5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:06.422453 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-ba6db0aa-7ccb-476b-8fd2-f4ec49186a5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:06.428433 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ba6db0aa-7ccb-476b-8fd2-f4ec49186a5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:06.428913 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ba6db0aa-7ccb-476b-8fd2-f4ec49186a5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:06.429344 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ba6db0aa-7ccb-476b-8fd2-f4ec49186a5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:06.432208 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ba6db0aa-7ccb-476b-8fd2-f4ec49186a5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:06.432681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ba6db0aa-7ccb-476b-8fd2-f4ec49186a5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:06.433263 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ba6db0aa-7ccb-476b-8fd2-f4ec49186a5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:06.436617 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-e07bd2d4-388d-4440-bd7a-f442355e2218 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:06.437240 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-e07bd2d4-388d-4440-bd7a-f442355e2218 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:06.444032 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e07bd2d4-388d-4440-bd7a-f442355e2218 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:06.444727 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e07bd2d4-388d-4440-bd7a-f442355e2218 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:06.445374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e07bd2d4-388d-4440-bd7a-f442355e2218 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:06.446154 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e07bd2d4-388d-4440-bd7a-f442355e2218 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:06.446605 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e07bd2d4-388d-4440-bd7a-f442355e2218 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:06.447826 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e07bd2d4-388d-4440-bd7a-f442355e2218 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:06.570251 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-ba6db0aa-7ccb-476b-8fd2-f4ec49186a5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:06.579420 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-ba6db0aa-7ccb-476b-8fd2-f4ec49186a5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:06.580954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-ba6db0aa-7ccb-476b-8fd2-f4ec49186a5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:06.582149 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-ba6db0aa-7ccb-476b-8fd2-f4ec49186a5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1404 microversion: 2.20 time: 0.165647 Oct 24 13:13:06.582764 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 42/73] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:13:06 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:13:06.666722 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-e07bd2d4-388d-4440-bd7a-f442355e2218 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:06.676492 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-e07bd2d4-388d-4440-bd7a-f442355e2218 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1321 microversion: 2.1 time: 0.243891 Oct 24 13:13:06.677066 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 32/74] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:06 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:13:06.781341 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-9f4cbed6-65c7-444e-bb28-86aacaf8ade7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:06.781965 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-9f4cbed6-65c7-444e-bb28-86aacaf8ade7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:06.796776 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9f4cbed6-65c7-444e-bb28-86aacaf8ade7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:06.800895 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9f4cbed6-65c7-444e-bb28-86aacaf8ade7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:06.802319 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9f4cbed6-65c7-444e-bb28-86aacaf8ade7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:06.803872 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9f4cbed6-65c7-444e-bb28-86aacaf8ade7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:06.806385 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9f4cbed6-65c7-444e-bb28-86aacaf8ade7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:06.807588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9f4cbed6-65c7-444e-bb28-86aacaf8ade7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:07.183194 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-67e363e6-b61f-43c8-82ad-82b5b3bb7b80 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52bbb559-fda6-464c-aefd-2728a8c45cab"}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:13:07.185593 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-67e363e6-b61f-43c8-82ad-82b5b3bb7b80 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:07.198744 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-67e363e6-b61f-43c8-82ad-82b5b3bb7b80 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:07.199306 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-67e363e6-b61f-43c8-82ad-82b5b3bb7b80 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:07.199743 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-67e363e6-b61f-43c8-82ad-82b5b3bb7b80 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:07.200451 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-67e363e6-b61f-43c8-82ad-82b5b3bb7b80 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:07.200909 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-67e363e6-b61f-43c8-82ad-82b5b3bb7b80 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:07.201333 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-67e363e6-b61f-43c8-82ad-82b5b3bb7b80 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:07.330422 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-9f4cbed6-65c7-444e-bb28-86aacaf8ade7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:07.340204 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-9f4cbed6-65c7-444e-bb28-86aacaf8ade7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b" status: 200 len: 1367 microversion: 2.1 time: 0.564677 Oct 24 13:13:07.341223 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 43/75] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:06 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b => generated 1367 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:07.608211 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-7226d90b-210b-4cae-b545-881234c91099 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:07.608859 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-7226d90b-210b-4cae-b545-881234c91099 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:07.617019 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7226d90b-210b-4cae-b545-881234c91099 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:07.617624 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7226d90b-210b-4cae-b545-881234c91099 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:07.617943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7226d90b-210b-4cae-b545-881234c91099 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:07.618651 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7226d90b-210b-4cae-b545-881234c91099 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:07.620887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7226d90b-210b-4cae-b545-881234c91099 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:07.624192 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7226d90b-210b-4cae-b545-881234c91099 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:07.899394 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=4 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:08.199693 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-7226d90b-210b-4cae-b545-881234c91099 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:08.210084 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-7226d90b-210b-4cae-b545-881234c91099 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:08.211735 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-7226d90b-210b-4cae-b545-881234c91099 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:08.212979 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-7226d90b-210b-4cae-b545-881234c91099 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1404 microversion: 2.20 time: 0.608981 Oct 24 13:13:08.213974 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 44/76] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:13:07 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1404 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:13:08.220071 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-2f8cd8b2-e048-4a88-a6ef-699dc1f3c186 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:08.220992 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-2f8cd8b2-e048-4a88-a6ef-699dc1f3c186 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:08.254369 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f8cd8b2-e048-4a88-a6ef-699dc1f3c186 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:08.254869 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f8cd8b2-e048-4a88-a6ef-699dc1f3c186 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:08.255340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f8cd8b2-e048-4a88-a6ef-699dc1f3c186 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:08.256255 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f8cd8b2-e048-4a88-a6ef-699dc1f3c186 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:08.256716 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f8cd8b2-e048-4a88-a6ef-699dc1f3c186 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:08.257155 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f8cd8b2-e048-4a88-a6ef-699dc1f3c186 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:08.531016 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-2f8cd8b2-e048-4a88-a6ef-699dc1f3c186 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:08.542606 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-2f8cd8b2-e048-4a88-a6ef-699dc1f3c186 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1321 microversion: 2.1 time: 0.324921 Oct 24 13:13:08.543591 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 45/77] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:08 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:08.562554 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-4f48a9e1-862f-4a7b-b97b-e846a79edf43 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:08.569081 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-4f48a9e1-862f-4a7b-b97b-e846a79edf43 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:08.580315 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4f48a9e1-862f-4a7b-b97b-e846a79edf43 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:08.580971 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4f48a9e1-862f-4a7b-b97b-e846a79edf43 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:08.581582 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4f48a9e1-862f-4a7b-b97b-e846a79edf43 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:08.582578 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4f48a9e1-862f-4a7b-b97b-e846a79edf43 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:08.583444 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4f48a9e1-862f-4a7b-b97b-e846a79edf43 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:08.583874 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4f48a9e1-862f-4a7b-b97b-e846a79edf43 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:08.731509 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-67e363e6-b61f-43c8-82ad-82b5b3bb7b80 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "POST /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.551216 Oct 24 13:13:08.732428 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 33/78] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 24 13:13:07 2022] POST /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9/os-volume_attachments => generated 194 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:13:08.786692 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-4f48a9e1-862f-4a7b-b97b-e846a79edf43 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:08.799719 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-4f48a9e1-862f-4a7b-b97b-e846a79edf43 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b" status: 200 len: 1367 microversion: 2.1 time: 0.254278 Oct 24 13:13:08.800417 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 46/79] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:08 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:09.242214 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-97902f77-4913-495e-a8a1-8e4da9e0d773 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:09.243478 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-97902f77-4913-495e-a8a1-8e4da9e0d773 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:09.254084 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-97902f77-4913-495e-a8a1-8e4da9e0d773 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:09.255105 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-97902f77-4913-495e-a8a1-8e4da9e0d773 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:09.255748 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-97902f77-4913-495e-a8a1-8e4da9e0d773 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:09.257142 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-97902f77-4913-495e-a8a1-8e4da9e0d773 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:09.258110 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-97902f77-4913-495e-a8a1-8e4da9e0d773 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:09.258862 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-97902f77-4913-495e-a8a1-8e4da9e0d773 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:09.444060 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-97902f77-4913-495e-a8a1-8e4da9e0d773 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:09.456324 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-97902f77-4913-495e-a8a1-8e4da9e0d773 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:09.460528 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-97902f77-4913-495e-a8a1-8e4da9e0d773 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:09.461960 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-97902f77-4913-495e-a8a1-8e4da9e0d773 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1404 microversion: 2.20 time: 0.225293 Oct 24 13:13:09.463090 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 34/80] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:13:09 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1404 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:13:09.565956 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-2e1683db-8340-4592-8cc3-5c77813b825d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:09.566889 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-2e1683db-8340-4592-8cc3-5c77813b825d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:09.580605 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2e1683db-8340-4592-8cc3-5c77813b825d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:09.581174 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2e1683db-8340-4592-8cc3-5c77813b825d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:09.581456 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2e1683db-8340-4592-8cc3-5c77813b825d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:09.582258 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2e1683db-8340-4592-8cc3-5c77813b825d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:09.582609 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2e1683db-8340-4592-8cc3-5c77813b825d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:09.583030 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2e1683db-8340-4592-8cc3-5c77813b825d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:09.827349 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-15b7f542-7b3d-4217-91d7-baec4eda51d4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:09.828452 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-15b7f542-7b3d-4217-91d7-baec4eda51d4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:09.856499 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-15b7f542-7b3d-4217-91d7-baec4eda51d4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:09.867835 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-15b7f542-7b3d-4217-91d7-baec4eda51d4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:09.868537 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-15b7f542-7b3d-4217-91d7-baec4eda51d4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:09.869333 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-15b7f542-7b3d-4217-91d7-baec4eda51d4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:09.877582 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-15b7f542-7b3d-4217-91d7-baec4eda51d4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:09.878081 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-15b7f542-7b3d-4217-91d7-baec4eda51d4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:10.042443 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-2e1683db-8340-4592-8cc3-5c77813b825d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:10.071565 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-2e1683db-8340-4592-8cc3-5c77813b825d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1516 microversion: 2.1 time: 0.507308 Oct 24 13:13:10.077771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 47/81] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:09 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1516 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:10.118413 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-2da029b6-814e-40a9-83fe-c825e057c07f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:13:10.128205 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-2da029b6-814e-40a9-83fe-c825e057c07f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:10.158333 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2da029b6-814e-40a9-83fe-c825e057c07f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:10.159461 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2da029b6-814e-40a9-83fe-c825e057c07f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:10.161509 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2da029b6-814e-40a9-83fe-c825e057c07f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:10.164531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2da029b6-814e-40a9-83fe-c825e057c07f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:10.173423 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2da029b6-814e-40a9-83fe-c825e057c07f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:10.175554 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2da029b6-814e-40a9-83fe-c825e057c07f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:10.315550 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.objects.instance [None req-2da029b6-814e-40a9-83fe-c825e057c07f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lazy-loading 'flavor' on Instance uuid 6aac99c2-2d97-41c4-b44c-629b52631804 {{(pid=118914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:13:10.422854 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=100 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:10.539851 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-2da029b6-814e-40a9-83fe-c825e057c07f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "POST /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804/action" status: 200 len: 32 microversion: 2.1 time: 0.433282 Oct 24 13:13:10.544578 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 48/82] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 24 13:13:10 2022] POST /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804/action => generated 32 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:13:10.554249 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-52e93085-4ebb-4eef-accc-8a79040f710c req-3a69a620-d41d-43f9-aa41-52955f0a69f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d11b9d-5ddc-4747-9632-d652e6c93b7b", "name": "network-vif-plugged", "status": "completed", "tag": "3279f147-249f-4187-bbc4-6ce7f6ef81c1"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:13:10.589406 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-52e93085-4ebb-4eef-accc-8a79040f710c req-3a69a620-d41d-43f9-aa41-52955f0a69f2 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:10.598933 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-52e93085-4ebb-4eef-accc-8a79040f710c req-3a69a620-d41d-43f9-aa41-52955f0a69f2 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:10.599654 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-52e93085-4ebb-4eef-accc-8a79040f710c req-3a69a620-d41d-43f9-aa41-52955f0a69f2 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:10.615183 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-52e93085-4ebb-4eef-accc-8a79040f710c req-3a69a620-d41d-43f9-aa41-52955f0a69f2 service nova] Creating event network-vif-plugged:3279f147-249f-4187-bbc4-6ce7f6ef81c1 for instance b0d11b9d-5ddc-4747-9632-d652e6c93b7b on hv-cinder-86248 Oct 24 13:13:10.624661 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-52e93085-4ebb-4eef-accc-8a79040f710c req-3a69a620-d41d-43f9-aa41-52955f0a69f2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075856 Oct 24 13:13:10.625759 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 49/83] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:13:10.633839 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-1c8fc17d-dd4c-4ca5-880a-65e4fb7e0857 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:10.634707 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-1c8fc17d-dd4c-4ca5-880a-65e4fb7e0857 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:10.646633 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1c8fc17d-dd4c-4ca5-880a-65e4fb7e0857 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:10.647365 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1c8fc17d-dd4c-4ca5-880a-65e4fb7e0857 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:10.647946 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1c8fc17d-dd4c-4ca5-880a-65e4fb7e0857 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:10.648817 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1c8fc17d-dd4c-4ca5-880a-65e4fb7e0857 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:10.649408 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1c8fc17d-dd4c-4ca5-880a-65e4fb7e0857 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:10.650746 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1c8fc17d-dd4c-4ca5-880a-65e4fb7e0857 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:10.735795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-15b7f542-7b3d-4217-91d7-baec4eda51d4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:10.752188 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-15b7f542-7b3d-4217-91d7-baec4eda51d4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b" status: 200 len: 1367 microversion: 2.1 time: 0.931574 Oct 24 13:13:10.752728 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 35/84] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:09 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b => generated 1367 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:10.776252 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-4f4d033b-a9be-45de-adf3-37d7be6989ab tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:10.777477 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-4f4d033b-a9be-45de-adf3-37d7be6989ab tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:10.784357 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4f4d033b-a9be-45de-adf3-37d7be6989ab tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:10.784853 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4f4d033b-a9be-45de-adf3-37d7be6989ab tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:10.785315 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4f4d033b-a9be-45de-adf3-37d7be6989ab tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:10.786025 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4f4d033b-a9be-45de-adf3-37d7be6989ab tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:10.786503 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4f4d033b-a9be-45de-adf3-37d7be6989ab tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:10.786955 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4f4d033b-a9be-45de-adf3-37d7be6989ab tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:11.036783 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-4f4d033b-a9be-45de-adf3-37d7be6989ab tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:11.049231 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-4f4d033b-a9be-45de-adf3-37d7be6989ab tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.277476 Oct 24 13:13:11.049800 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 36/85] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:10 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:11.132221 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-1c8fc17d-dd4c-4ca5-880a-65e4fb7e0857 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:11.144736 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-1c8fc17d-dd4c-4ca5-880a-65e4fb7e0857 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:11.146288 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-1c8fc17d-dd4c-4ca5-880a-65e4fb7e0857 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:11.147877 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-1c8fc17d-dd4c-4ca5-880a-65e4fb7e0857 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1404 microversion: 2.20 time: 0.520867 Oct 24 13:13:11.160033 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 50/86] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:13:10 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1404 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:13:11.777984 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-c4470dd6-93f4-4816-9945-2c0f52f8610a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:11.779112 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-c4470dd6-93f4-4816-9945-2c0f52f8610a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:11.787500 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c4470dd6-93f4-4816-9945-2c0f52f8610a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:11.787976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c4470dd6-93f4-4816-9945-2c0f52f8610a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:11.788404 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c4470dd6-93f4-4816-9945-2c0f52f8610a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:11.789086 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c4470dd6-93f4-4816-9945-2c0f52f8610a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:11.789694 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c4470dd6-93f4-4816-9945-2c0f52f8610a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:11.790133 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c4470dd6-93f4-4816-9945-2c0f52f8610a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:11.973406 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-c4470dd6-93f4-4816-9945-2c0f52f8610a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:11.983928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-c4470dd6-93f4-4816-9945-2c0f52f8610a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b" status: 200 len: 1367 microversion: 2.1 time: 0.209929 Oct 24 13:13:11.985011 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 37/87] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:11 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:12.073442 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-fa5142f5-77d9-458c-824d-8cc1fd80bb41 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:12.074055 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-fa5142f5-77d9-458c-824d-8cc1fd80bb41 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:12.084317 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa5142f5-77d9-458c-824d-8cc1fd80bb41 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:12.084801 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa5142f5-77d9-458c-824d-8cc1fd80bb41 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:12.088073 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa5142f5-77d9-458c-824d-8cc1fd80bb41 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:12.089417 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa5142f5-77d9-458c-824d-8cc1fd80bb41 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:12.090117 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa5142f5-77d9-458c-824d-8cc1fd80bb41 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:12.090770 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa5142f5-77d9-458c-824d-8cc1fd80bb41 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:12.173648 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-5153f822-6c16-462b-be23-a0203116d988 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:12.174771 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-5153f822-6c16-462b-be23-a0203116d988 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:12.187217 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5153f822-6c16-462b-be23-a0203116d988 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:12.188012 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5153f822-6c16-462b-be23-a0203116d988 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:12.188617 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5153f822-6c16-462b-be23-a0203116d988 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:12.189459 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5153f822-6c16-462b-be23-a0203116d988 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:12.190054 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5153f822-6c16-462b-be23-a0203116d988 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:12.190633 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5153f822-6c16-462b-be23-a0203116d988 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:12.276244 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-fa5142f5-77d9-458c-824d-8cc1fd80bb41 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:12.287158 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-fa5142f5-77d9-458c-824d-8cc1fd80bb41 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.217386 Oct 24 13:13:12.288537 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 51/88] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:12 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:12.377224 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-5153f822-6c16-462b-be23-a0203116d988 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:12.386406 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-5153f822-6c16-462b-be23-a0203116d988 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:12.388152 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-5153f822-6c16-462b-be23-a0203116d988 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:12.389764 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-5153f822-6c16-462b-be23-a0203116d988 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1404 microversion: 2.20 time: 0.220732 Oct 24 13:13:12.390834 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 38/89] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:13:12 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1404 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:13:13.013792 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-1cbc1dde-44ac-4533-9010-7ffcd5f28b07 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:13.014391 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-1cbc1dde-44ac-4533-9010-7ffcd5f28b07 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:13.028949 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1cbc1dde-44ac-4533-9010-7ffcd5f28b07 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:13.029843 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1cbc1dde-44ac-4533-9010-7ffcd5f28b07 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:13.031352 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1cbc1dde-44ac-4533-9010-7ffcd5f28b07 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:13.033018 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1cbc1dde-44ac-4533-9010-7ffcd5f28b07 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:13.034714 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1cbc1dde-44ac-4533-9010-7ffcd5f28b07 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:13.035822 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1cbc1dde-44ac-4533-9010-7ffcd5f28b07 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:13.224460 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-1cbc1dde-44ac-4533-9010-7ffcd5f28b07 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:13.232982 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-1cbc1dde-44ac-4533-9010-7ffcd5f28b07 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b" status: 200 len: 1367 microversion: 2.1 time: 0.226084 Oct 24 13:13:13.233690 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 52/90] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:13 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:13.312206 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-c985d05c-b030-47bc-8dd0-1ef691e2f1dc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:13.312839 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-c985d05c-b030-47bc-8dd0-1ef691e2f1dc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:13.319209 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c985d05c-b030-47bc-8dd0-1ef691e2f1dc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:13.319691 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c985d05c-b030-47bc-8dd0-1ef691e2f1dc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:13.320127 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c985d05c-b030-47bc-8dd0-1ef691e2f1dc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:13.320813 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c985d05c-b030-47bc-8dd0-1ef691e2f1dc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:13.321267 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c985d05c-b030-47bc-8dd0-1ef691e2f1dc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:13.321693 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c985d05c-b030-47bc-8dd0-1ef691e2f1dc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:13.413803 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-720a34bd-6ee6-44e7-9681-36b2114cdc79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:13.414413 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-720a34bd-6ee6-44e7-9681-36b2114cdc79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:13.420542 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-720a34bd-6ee6-44e7-9681-36b2114cdc79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:13.421030 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-720a34bd-6ee6-44e7-9681-36b2114cdc79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:13.421463 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-720a34bd-6ee6-44e7-9681-36b2114cdc79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:13.422151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-720a34bd-6ee6-44e7-9681-36b2114cdc79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:13.422598 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-720a34bd-6ee6-44e7-9681-36b2114cdc79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:13.423017 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-720a34bd-6ee6-44e7-9681-36b2114cdc79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:13.462993 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-c985d05c-b030-47bc-8dd0-1ef691e2f1dc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:13.471879 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-c985d05c-b030-47bc-8dd0-1ef691e2f1dc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.163508 Oct 24 13:13:13.472456 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 39/91] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:13 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:13.555231 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-720a34bd-6ee6-44e7-9681-36b2114cdc79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:13.565229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-720a34bd-6ee6-44e7-9681-36b2114cdc79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:13.566651 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-720a34bd-6ee6-44e7-9681-36b2114cdc79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:13.567782 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-720a34bd-6ee6-44e7-9681-36b2114cdc79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1404 microversion: 2.20 time: 0.157942 Oct 24 13:13:13.568337 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 53/92] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:13:13 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:13:14.255658 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-ae65e5de-15fc-4c2f-89bd-f5e841b42168 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:14.256272 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-ae65e5de-15fc-4c2f-89bd-f5e841b42168 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:14.268211 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ae65e5de-15fc-4c2f-89bd-f5e841b42168 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:14.268672 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ae65e5de-15fc-4c2f-89bd-f5e841b42168 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:14.269399 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ae65e5de-15fc-4c2f-89bd-f5e841b42168 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:14.270212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ae65e5de-15fc-4c2f-89bd-f5e841b42168 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:14.270661 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ae65e5de-15fc-4c2f-89bd-f5e841b42168 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:14.271094 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ae65e5de-15fc-4c2f-89bd-f5e841b42168 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:14.469185 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-ae65e5de-15fc-4c2f-89bd-f5e841b42168 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:14.471918 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:14.488508 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-ae65e5de-15fc-4c2f-89bd-f5e841b42168 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b" status: 200 len: 1557 microversion: 2.1 time: 0.226953 Oct 24 13:13:14.488508 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 40/93] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:14 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b => generated 1557 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:14.495736 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-2763a81f-678f-4472-a84f-45246276fae3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:14.496730 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-2763a81f-678f-4472-a84f-45246276fae3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:14.503492 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2763a81f-678f-4472-a84f-45246276fae3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:14.503988 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2763a81f-678f-4472-a84f-45246276fae3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:14.504426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2763a81f-678f-4472-a84f-45246276fae3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:14.505122 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2763a81f-678f-4472-a84f-45246276fae3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:14.505274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-ba6968b0-fd9d-410e-ba57-e8e0b062b507 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:14.505797 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2763a81f-678f-4472-a84f-45246276fae3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:14.506230 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2763a81f-678f-4472-a84f-45246276fae3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:14.506372 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-ba6968b0-fd9d-410e-ba57-e8e0b062b507 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:14.515287 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ba6968b0-fd9d-410e-ba57-e8e0b062b507 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:14.515908 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ba6968b0-fd9d-410e-ba57-e8e0b062b507 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:14.516766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ba6968b0-fd9d-410e-ba57-e8e0b062b507 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:14.517492 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ba6968b0-fd9d-410e-ba57-e8e0b062b507 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:14.518017 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ba6968b0-fd9d-410e-ba57-e8e0b062b507 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:14.518439 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ba6968b0-fd9d-410e-ba57-e8e0b062b507 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:14.631245 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-ba6968b0-fd9d-410e-ba57-e8e0b062b507 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.129882 Oct 24 13:13:14.631957 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 41/94] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Oct 24 13:13:14 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b/os-interface => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:13:14.637295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-16b584a7-0597-454c-a590-318aba57d7be tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:14.637977 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-16b584a7-0597-454c-a590-318aba57d7be tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:14.659214 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-16b584a7-0597-454c-a590-318aba57d7be tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:14.660050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-16b584a7-0597-454c-a590-318aba57d7be tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:14.660780 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-16b584a7-0597-454c-a590-318aba57d7be tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:14.661723 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-16b584a7-0597-454c-a590-318aba57d7be tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:14.662378 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-16b584a7-0597-454c-a590-318aba57d7be tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:14.663091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-16b584a7-0597-454c-a590-318aba57d7be tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:14.707234 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-2763a81f-678f-4472-a84f-45246276fae3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:14.718938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-2763a81f-678f-4472-a84f-45246276fae3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.227674 Oct 24 13:13:14.719551 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 54/95] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:14 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:15.021647 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-16b584a7-0597-454c-a590-318aba57d7be tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:15.030285 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-16b584a7-0597-454c-a590-318aba57d7be tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:15.031869 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-16b584a7-0597-454c-a590-318aba57d7be tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:15.033053 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-16b584a7-0597-454c-a590-318aba57d7be tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1404 microversion: 2.20 time: 0.399770 Oct 24 13:13:15.033730 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 42/96] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:13:14 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1404 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:13:15.745255 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-792789f6-87e3-4fb9-b974-fbb3f557409b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:15.746591 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-792789f6-87e3-4fb9-b974-fbb3f557409b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:15.761411 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-792789f6-87e3-4fb9-b974-fbb3f557409b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:15.762788 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-792789f6-87e3-4fb9-b974-fbb3f557409b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:15.765334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-792789f6-87e3-4fb9-b974-fbb3f557409b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:15.767827 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-792789f6-87e3-4fb9-b974-fbb3f557409b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:15.768864 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-792789f6-87e3-4fb9-b974-fbb3f557409b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:15.771180 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-792789f6-87e3-4fb9-b974-fbb3f557409b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:15.972095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-792789f6-87e3-4fb9-b974-fbb3f557409b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:15.983231 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-792789f6-87e3-4fb9-b974-fbb3f557409b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.240966 Oct 24 13:13:15.984312 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 55/97] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:15 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:16.022226 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-f629d313-4eec-4994-8f22-2bd178178775 req-25e225ca-ce75-48b2-b33e-45696936df4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b5963f-5199-4822-a8c3-20a8ab09224f", "name": "network-vif-plugged", "status": "completed", "tag": "9241fec5-c702-4043-a917-794ed6ca4105"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:13:16.049212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-f629d313-4eec-4994-8f22-2bd178178775 req-25e225ca-ce75-48b2-b33e-45696936df4f service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:16.049708 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-f629d313-4eec-4994-8f22-2bd178178775 req-25e225ca-ce75-48b2-b33e-45696936df4f service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:16.053375 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-f629d313-4eec-4994-8f22-2bd178178775 req-25e225ca-ce75-48b2-b33e-45696936df4f service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:16.059825 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-f32e3aa2-08fd-4a05-9b54-1621ae998204 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:16.060652 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-f32e3aa2-08fd-4a05-9b54-1621ae998204 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:16.093584 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f32e3aa2-08fd-4a05-9b54-1621ae998204 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:16.094541 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f32e3aa2-08fd-4a05-9b54-1621ae998204 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:16.096172 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f32e3aa2-08fd-4a05-9b54-1621ae998204 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:16.097367 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f32e3aa2-08fd-4a05-9b54-1621ae998204 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:16.098292 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f32e3aa2-08fd-4a05-9b54-1621ae998204 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:16.098872 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f32e3aa2-08fd-4a05-9b54-1621ae998204 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:16.101265 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-f629d313-4eec-4994-8f22-2bd178178775 req-25e225ca-ce75-48b2-b33e-45696936df4f service nova] Creating event network-vif-plugged:9241fec5-c702-4043-a917-794ed6ca4105 for instance 27b5963f-5199-4822-a8c3-20a8ab09224f on hv-cinder-86248 Oct 24 13:13:16.121485 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-f629d313-4eec-4994-8f22-2bd178178775 req-25e225ca-ce75-48b2-b33e-45696936df4f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124553 Oct 24 13:13:16.128333 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 43/98] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:13:16.371106 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-f32e3aa2-08fd-4a05-9b54-1621ae998204 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:16.378792 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-e3f86390-53d8-4ff6-9a77-8446e299d605 req-e90332dd-18c2-4c50-90fb-a5c09f6b9f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0d11b9d-5ddc-4747-9632-d652e6c93b7b", "tag": "3279f147-249f-4187-bbc4-6ce7f6ef81c1"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:13:16.395221 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-f32e3aa2-08fd-4a05-9b54-1621ae998204 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:16.399306 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-e3f86390-53d8-4ff6-9a77-8446e299d605 req-e90332dd-18c2-4c50-90fb-a5c09f6b9f2d service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:16.401333 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-f32e3aa2-08fd-4a05-9b54-1621ae998204 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:16.402619 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-f32e3aa2-08fd-4a05-9b54-1621ae998204 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1404 microversion: 2.20 time: 0.347441 Oct 24 13:13:16.403341 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 56/99] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:13:16 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1404 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:13:16.404359 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-e3f86390-53d8-4ff6-9a77-8446e299d605 req-e90332dd-18c2-4c50-90fb-a5c09f6b9f2d service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:16.405623 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-e3f86390-53d8-4ff6-9a77-8446e299d605 req-e90332dd-18c2-4c50-90fb-a5c09f6b9f2d service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:16.437984 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-e3f86390-53d8-4ff6-9a77-8446e299d605 req-e90332dd-18c2-4c50-90fb-a5c09f6b9f2d service nova] Creating event network-changed:3279f147-249f-4187-bbc4-6ce7f6ef81c1 for instance b0d11b9d-5ddc-4747-9632-d652e6c93b7b on hv-cinder-86248 Oct 24 13:13:16.452292 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-e3f86390-53d8-4ff6-9a77-8446e299d605 req-e90332dd-18c2-4c50-90fb-a5c09f6b9f2d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078404 Oct 24 13:13:16.453226 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 44/100] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:13:17.012638 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-560da134-bb9b-44fc-9e52-0a928fe0744e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:17.014962 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-560da134-bb9b-44fc-9e52-0a928fe0744e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:17.024562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-560da134-bb9b-44fc-9e52-0a928fe0744e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:17.025828 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-560da134-bb9b-44fc-9e52-0a928fe0744e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:17.026461 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-560da134-bb9b-44fc-9e52-0a928fe0744e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:17.027386 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-560da134-bb9b-44fc-9e52-0a928fe0744e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:17.028178 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-560da134-bb9b-44fc-9e52-0a928fe0744e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:17.029228 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-560da134-bb9b-44fc-9e52-0a928fe0744e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:17.395665 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-560da134-bb9b-44fc-9e52-0a928fe0744e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:17.424879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-560da134-bb9b-44fc-9e52-0a928fe0744e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.417285 Oct 24 13:13:17.425899 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 57/101] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:17 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:17.430535 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-24cc9551-ca5f-47e0-a0fd-b3e1c7890776 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:17.431289 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-24cc9551-ca5f-47e0-a0fd-b3e1c7890776 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:17.441734 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-24cc9551-ca5f-47e0-a0fd-b3e1c7890776 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:17.442219 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-24cc9551-ca5f-47e0-a0fd-b3e1c7890776 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:17.442643 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-24cc9551-ca5f-47e0-a0fd-b3e1c7890776 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:17.443377 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-24cc9551-ca5f-47e0-a0fd-b3e1c7890776 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:17.443829 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-24cc9551-ca5f-47e0-a0fd-b3e1c7890776 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:17.444248 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-24cc9551-ca5f-47e0-a0fd-b3e1c7890776 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:17.801203 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-24cc9551-ca5f-47e0-a0fd-b3e1c7890776 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:17.814713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-24cc9551-ca5f-47e0-a0fd-b3e1c7890776 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:17.826043 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-24cc9551-ca5f-47e0-a0fd-b3e1c7890776 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:17.830951 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-24cc9551-ca5f-47e0-a0fd-b3e1c7890776 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1404 microversion: 2.20 time: 0.404987 Oct 24 13:13:17.842850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 45/102] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:13:17 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:13:18.160703 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-785286dc-f189-4d91-91f1-0f3f46500610 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:18.161233 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-785286dc-f189-4d91-91f1-0f3f46500610 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:18.171170 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-785286dc-f189-4d91-91f1-0f3f46500610 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:18.171690 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-785286dc-f189-4d91-91f1-0f3f46500610 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:18.173360 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-785286dc-f189-4d91-91f1-0f3f46500610 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:18.175604 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-785286dc-f189-4d91-91f1-0f3f46500610 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:18.175952 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-785286dc-f189-4d91-91f1-0f3f46500610 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:18.177843 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-785286dc-f189-4d91-91f1-0f3f46500610 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:18.213023 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-785286dc-f189-4d91-91f1-0f3f46500610 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Going to try to terminate instance {{(pid=118914) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:13:18.393843 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-785286dc-f189-4d91-91f1-0f3f46500610 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 204 len: 0 microversion: 2.1 time: 0.236523 Oct 24 13:13:18.395241 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 58/103] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:13:18 2022] DELETE /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:13:18.404171 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-4d0f2921-29de-4c48-83dc-e48ace43a23d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:18.405100 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-4d0f2921-29de-4c48-83dc-e48ace43a23d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:18.414059 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4d0f2921-29de-4c48-83dc-e48ace43a23d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:18.416180 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4d0f2921-29de-4c48-83dc-e48ace43a23d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:18.417596 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4d0f2921-29de-4c48-83dc-e48ace43a23d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:18.424053 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4d0f2921-29de-4c48-83dc-e48ace43a23d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:18.424545 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4d0f2921-29de-4c48-83dc-e48ace43a23d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:18.424979 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4d0f2921-29de-4c48-83dc-e48ace43a23d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:18.450495 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-54539af3-49c2-4b71-89a0-c518f7707731 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:18.451300 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-54539af3-49c2-4b71-89a0-c518f7707731 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:18.468401 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-54539af3-49c2-4b71-89a0-c518f7707731 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:18.468922 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-54539af3-49c2-4b71-89a0-c518f7707731 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:18.469368 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-54539af3-49c2-4b71-89a0-c518f7707731 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:18.470076 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-54539af3-49c2-4b71-89a0-c518f7707731 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:18.470554 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-54539af3-49c2-4b71-89a0-c518f7707731 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:18.470973 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-54539af3-49c2-4b71-89a0-c518f7707731 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:18.614827 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-4d0f2921-29de-4c48-83dc-e48ace43a23d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e637d319f449f38e4d6375ae5b22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c837e1766e0141ea9b868b89efee5ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:18.635939 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-4d0f2921-29de-4c48-83dc-e48ace43a23d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 200 len: 1555 microversion: 2.1 time: 0.236313 Oct 24 13:13:18.636603 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 46/104] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:18 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 1555 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:18.718774 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-54539af3-49c2-4b71-89a0-c518f7707731 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:18.736610 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-54539af3-49c2-4b71-89a0-c518f7707731 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.290552 Oct 24 13:13:18.737614 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 59/105] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:18 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:18.859961 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-bfef0b06-50b4-4d62-b8ad-cbb4ab298832 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:18.860781 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-bfef0b06-50b4-4d62-b8ad-cbb4ab298832 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:18.866725 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bfef0b06-50b4-4d62-b8ad-cbb4ab298832 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:18.867427 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bfef0b06-50b4-4d62-b8ad-cbb4ab298832 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:18.867839 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bfef0b06-50b4-4d62-b8ad-cbb4ab298832 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:18.869952 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bfef0b06-50b4-4d62-b8ad-cbb4ab298832 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:18.870423 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bfef0b06-50b4-4d62-b8ad-cbb4ab298832 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:18.870856 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bfef0b06-50b4-4d62-b8ad-cbb4ab298832 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:19.025981 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-bfef0b06-50b4-4d62-b8ad-cbb4ab298832 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:19.036391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-bfef0b06-50b4-4d62-b8ad-cbb4ab298832 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:19.037976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-bfef0b06-50b4-4d62-b8ad-cbb4ab298832 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:19.039302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-bfef0b06-50b4-4d62-b8ad-cbb4ab298832 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1404 microversion: 2.20 time: 0.184067 Oct 24 13:13:19.040214 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 47/106] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:13:18 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1404 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:13:19.662312 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-64b68dfe-1cad-46bf-9d51-315db625f5f9 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:19.662994 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-64b68dfe-1cad-46bf-9d51-315db625f5f9 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:19.678535 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-64b68dfe-1cad-46bf-9d51-315db625f5f9 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:19.678952 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-64b68dfe-1cad-46bf-9d51-315db625f5f9 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:19.679437 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-64b68dfe-1cad-46bf-9d51-315db625f5f9 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:19.680134 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-64b68dfe-1cad-46bf-9d51-315db625f5f9 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:19.680587 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-64b68dfe-1cad-46bf-9d51-315db625f5f9 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:19.681025 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-64b68dfe-1cad-46bf-9d51-315db625f5f9 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:19.769998 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-946f1e2d-f7c9-48ad-894d-9bc1d29752af tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:19.776502 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-946f1e2d-f7c9-48ad-894d-9bc1d29752af tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:19.785108 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-946f1e2d-f7c9-48ad-894d-9bc1d29752af tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:19.785813 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-946f1e2d-f7c9-48ad-894d-9bc1d29752af tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:19.786515 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-946f1e2d-f7c9-48ad-894d-9bc1d29752af tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:19.787458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-946f1e2d-f7c9-48ad-894d-9bc1d29752af tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:19.788296 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-946f1e2d-f7c9-48ad-894d-9bc1d29752af tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:19.798480 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-946f1e2d-f7c9-48ad-894d-9bc1d29752af tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:19.862275 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-64b68dfe-1cad-46bf-9d51-315db625f5f9 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e637d319f449f38e4d6375ae5b22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c837e1766e0141ea9b868b89efee5ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:19.877064 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-64b68dfe-1cad-46bf-9d51-315db625f5f9 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 200 len: 1555 microversion: 2.1 time: 0.218824 Oct 24 13:13:19.878074 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 60/107] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:19 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 1555 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:19.980672 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-946f1e2d-f7c9-48ad-894d-9bc1d29752af tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:19.989649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-946f1e2d-f7c9-48ad-894d-9bc1d29752af tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.229744 Oct 24 13:13:19.990221 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 48/108] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:19 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:20.068002 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-812ea98d-f619-4eb3-97e3-4c9779ed3948 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:20.070780 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-812ea98d-f619-4eb3-97e3-4c9779ed3948 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:20.081536 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-812ea98d-f619-4eb3-97e3-4c9779ed3948 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:20.082992 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-812ea98d-f619-4eb3-97e3-4c9779ed3948 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:20.083664 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-812ea98d-f619-4eb3-97e3-4c9779ed3948 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:20.084698 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-812ea98d-f619-4eb3-97e3-4c9779ed3948 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:20.085427 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-812ea98d-f619-4eb3-97e3-4c9779ed3948 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:20.086654 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-812ea98d-f619-4eb3-97e3-4c9779ed3948 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:20.241424 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-812ea98d-f619-4eb3-97e3-4c9779ed3948 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:20.252356 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-812ea98d-f619-4eb3-97e3-4c9779ed3948 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:20.254905 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-812ea98d-f619-4eb3-97e3-4c9779ed3948 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:20.256195 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-812ea98d-f619-4eb3-97e3-4c9779ed3948 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1404 microversion: 2.20 time: 0.193416 Oct 24 13:13:20.259105 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 61/109] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:13:20 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1404 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:13:20.905779 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-db9cdf78-c1fc-48cb-ae9f-7433807e602a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:20.907782 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-db9cdf78-c1fc-48cb-ae9f-7433807e602a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:20.915328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-db9cdf78-c1fc-48cb-ae9f-7433807e602a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:20.916123 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-db9cdf78-c1fc-48cb-ae9f-7433807e602a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:20.917235 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-db9cdf78-c1fc-48cb-ae9f-7433807e602a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:20.918675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-db9cdf78-c1fc-48cb-ae9f-7433807e602a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:20.919165 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-db9cdf78-c1fc-48cb-ae9f-7433807e602a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:20.919585 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-db9cdf78-c1fc-48cb-ae9f-7433807e602a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:21.017570 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-4ac671f9-7973-4846-928e-239473283c4e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:21.018207 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-4ac671f9-7973-4846-928e-239473283c4e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:21.027675 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4ac671f9-7973-4846-928e-239473283c4e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:21.028492 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4ac671f9-7973-4846-928e-239473283c4e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:21.031443 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4ac671f9-7973-4846-928e-239473283c4e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:21.032959 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4ac671f9-7973-4846-928e-239473283c4e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:21.033633 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4ac671f9-7973-4846-928e-239473283c4e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:21.034288 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4ac671f9-7973-4846-928e-239473283c4e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:21.129677 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-db9cdf78-c1fc-48cb-ae9f-7433807e602a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e637d319f449f38e4d6375ae5b22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c837e1766e0141ea9b868b89efee5ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:21.141167 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-db9cdf78-c1fc-48cb-ae9f-7433807e602a tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 200 len: 1555 microversion: 2.1 time: 0.240948 Oct 24 13:13:21.156637 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 49/110] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:20 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 1555 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:21.283430 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-49751c5d-e893-4459-9929-85fe2e74abab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:21.284045 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-49751c5d-e893-4459-9929-85fe2e74abab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:21.297149 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-49751c5d-e893-4459-9929-85fe2e74abab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:21.298391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-49751c5d-e893-4459-9929-85fe2e74abab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:21.299861 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-49751c5d-e893-4459-9929-85fe2e74abab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:21.301212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-49751c5d-e893-4459-9929-85fe2e74abab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:21.311703 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-49751c5d-e893-4459-9929-85fe2e74abab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:21.312399 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-49751c5d-e893-4459-9929-85fe2e74abab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:21.525559 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-4ac671f9-7973-4846-928e-239473283c4e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:21.528375 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-49751c5d-e893-4459-9929-85fe2e74abab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:21.533956 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:21.541743 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-49751c5d-e893-4459-9929-85fe2e74abab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:21.542536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-49751c5d-e893-4459-9929-85fe2e74abab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:21.543735 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-49751c5d-e893-4459-9929-85fe2e74abab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1596 microversion: 2.20 time: 0.265450 Oct 24 13:13:21.545927 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-4ac671f9-7973-4846-928e-239473283c4e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.536556 Oct 24 13:13:21.548283 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 62/111] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:21 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:21.562835 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 50/112] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:13:21 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1596 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:13:21.580917 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-64c884f3-bea8-43ae-8297-0a7d43d8a9b9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:21.581472 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-64c884f3-bea8-43ae-8297-0a7d43d8a9b9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:21.589676 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-64c884f3-bea8-43ae-8297-0a7d43d8a9b9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:21.590392 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-64c884f3-bea8-43ae-8297-0a7d43d8a9b9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:21.590984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-64c884f3-bea8-43ae-8297-0a7d43d8a9b9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:21.592506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-64c884f3-bea8-43ae-8297-0a7d43d8a9b9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:21.593117 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-64c884f3-bea8-43ae-8297-0a7d43d8a9b9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:21.593845 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-64c884f3-bea8-43ae-8297-0a7d43d8a9b9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:21.744007 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-64c884f3-bea8-43ae-8297-0a7d43d8a9b9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.169374 Oct 24 13:13:21.744852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 63/113] 10.222.0.42 () {60 vars in 1316 bytes} [Mon Oct 24 13:13:21 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:13:22.071466 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-be72bd33-09f4-4447-8f37-049b7dae3f0e req-c439a921-e584-4f1b-bae5-08e59fb51f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d835cdc8-620a-46a9-83ce-d47557bf77a9", "name": "network-vif-deleted", "tag": "2f3a03dc-1d36-4c18-8e1f-75cf0fb9c347"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:13:22.084861 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-be72bd33-09f4-4447-8f37-049b7dae3f0e req-c439a921-e584-4f1b-bae5-08e59fb51f00 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:22.085668 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-be72bd33-09f4-4447-8f37-049b7dae3f0e req-c439a921-e584-4f1b-bae5-08e59fb51f00 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:22.086275 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-be72bd33-09f4-4447-8f37-049b7dae3f0e req-c439a921-e584-4f1b-bae5-08e59fb51f00 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:22.101765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-be72bd33-09f4-4447-8f37-049b7dae3f0e req-c439a921-e584-4f1b-bae5-08e59fb51f00 service nova] Creating event network-vif-deleted:2f3a03dc-1d36-4c18-8e1f-75cf0fb9c347 for instance d835cdc8-620a-46a9-83ce-d47557bf77a9 on hv-cinder-86248 Oct 24 13:13:22.112364 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-be72bd33-09f4-4447-8f37-049b7dae3f0e req-c439a921-e584-4f1b-bae5-08e59fb51f00 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044176 Oct 24 13:13:22.117162 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 51/114] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:13:22.167562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-19fdacec-5d77-4cec-b1d0-4132770bc4e3 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:22.168233 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-19fdacec-5d77-4cec-b1d0-4132770bc4e3 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:22.177619 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19fdacec-5d77-4cec-b1d0-4132770bc4e3 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:22.179525 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19fdacec-5d77-4cec-b1d0-4132770bc4e3 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:22.183945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19fdacec-5d77-4cec-b1d0-4132770bc4e3 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:22.185169 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19fdacec-5d77-4cec-b1d0-4132770bc4e3 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:22.186303 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19fdacec-5d77-4cec-b1d0-4132770bc4e3 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:22.188482 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19fdacec-5d77-4cec-b1d0-4132770bc4e3 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:22.330314 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-19fdacec-5d77-4cec-b1d0-4132770bc4e3 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e637d319f449f38e4d6375ae5b22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c837e1766e0141ea9b868b89efee5ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:22.341370 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-19fdacec-5d77-4cec-b1d0-4132770bc4e3 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 200 len: 1346 microversion: 2.1 time: 0.178188 Oct 24 13:13:22.346528 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 64/115] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:22 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 1346 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:22.572399 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-d386cf4f-49ec-42c6-bc6f-bfc7cf307186 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:22.572973 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-d386cf4f-49ec-42c6-bc6f-bfc7cf307186 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:22.582047 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d386cf4f-49ec-42c6-bc6f-bfc7cf307186 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:22.582740 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d386cf4f-49ec-42c6-bc6f-bfc7cf307186 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:22.584247 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d386cf4f-49ec-42c6-bc6f-bfc7cf307186 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:22.585150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d386cf4f-49ec-42c6-bc6f-bfc7cf307186 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:22.585781 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d386cf4f-49ec-42c6-bc6f-bfc7cf307186 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:22.586364 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d386cf4f-49ec-42c6-bc6f-bfc7cf307186 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:22.919800 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-d386cf4f-49ec-42c6-bc6f-bfc7cf307186 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:22.933154 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-d386cf4f-49ec-42c6-bc6f-bfc7cf307186 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.366193 Oct 24 13:13:22.934193 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 52/116] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:22 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:23.244595 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-d6774b54-0b14-44d8-80b6-28c4558cd56c req-de4a25c8-628e-4366-96cb-134fd185b8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27b5963f-5199-4822-a8c3-20a8ab09224f", "tag": "9241fec5-c702-4043-a917-794ed6ca4105"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:13:23.258596 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-d6774b54-0b14-44d8-80b6-28c4558cd56c req-de4a25c8-628e-4366-96cb-134fd185b8e1 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:23.259082 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-d6774b54-0b14-44d8-80b6-28c4558cd56c req-de4a25c8-628e-4366-96cb-134fd185b8e1 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:23.259513 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-d6774b54-0b14-44d8-80b6-28c4558cd56c req-de4a25c8-628e-4366-96cb-134fd185b8e1 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:23.271706 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-d6774b54-0b14-44d8-80b6-28c4558cd56c req-de4a25c8-628e-4366-96cb-134fd185b8e1 service nova] Creating event network-changed:9241fec5-c702-4043-a917-794ed6ca4105 for instance 27b5963f-5199-4822-a8c3-20a8ab09224f on hv-cinder-86248 Oct 24 13:13:23.277271 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-d6774b54-0b14-44d8-80b6-28c4558cd56c req-de4a25c8-628e-4366-96cb-134fd185b8e1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036355 Oct 24 13:13:23.278228 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 65/117] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:13:23.369644 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-d461e010-bf17-4e0f-8945-bfd42ce93db6 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:23.370422 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-d461e010-bf17-4e0f-8945-bfd42ce93db6 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:23.378768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d461e010-bf17-4e0f-8945-bfd42ce93db6 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:23.379811 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d461e010-bf17-4e0f-8945-bfd42ce93db6 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:23.380350 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d461e010-bf17-4e0f-8945-bfd42ce93db6 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:23.381153 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d461e010-bf17-4e0f-8945-bfd42ce93db6 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:23.382082 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d461e010-bf17-4e0f-8945-bfd42ce93db6 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:23.382931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d461e010-bf17-4e0f-8945-bfd42ce93db6 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:23.420161 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d461e010-bf17-4e0f-8945-bfd42ce93db6 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:23.420862 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d461e010-bf17-4e0f-8945-bfd42ce93db6 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:23.421353 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d461e010-bf17-4e0f-8945-bfd42ce93db6 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:23.422156 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.objects.instance [None req-d461e010-bf17-4e0f-8945-bfd42ce93db6 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lazy-loading 'fault' on Instance uuid d835cdc8-620a-46a9-83ce-d47557bf77a9 {{(pid=118915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:13:23.470032 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-d461e010-bf17-4e0f-8945-bfd42ce93db6 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e637d319f449f38e4d6375ae5b22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c837e1766e0141ea9b868b89efee5ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:23.478267 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-d461e010-bf17-4e0f-8945-bfd42ce93db6 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 200 len: 1351 microversion: 2.1 time: 0.113075 Oct 24 13:13:23.478998 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 53/118] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:23 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 1351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:23.958934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-5564cec6-3ddb-4e8d-9633-f5539549aa6d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:23.959912 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-5564cec6-3ddb-4e8d-9633-f5539549aa6d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:23.966102 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5564cec6-3ddb-4e8d-9633-f5539549aa6d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:23.966612 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5564cec6-3ddb-4e8d-9633-f5539549aa6d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:23.967385 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5564cec6-3ddb-4e8d-9633-f5539549aa6d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:23.968290 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5564cec6-3ddb-4e8d-9633-f5539549aa6d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:23.968749 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5564cec6-3ddb-4e8d-9633-f5539549aa6d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:23.969248 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5564cec6-3ddb-4e8d-9633-f5539549aa6d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:24.111578 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-5564cec6-3ddb-4e8d-9633-f5539549aa6d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:24.119607 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-5564cec6-3ddb-4e8d-9633-f5539549aa6d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.165212 Oct 24 13:13:24.120210 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 66/119] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:23 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:24.502737 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-34add831-9fd5-43bf-899f-babb8dfdf255 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:24.503664 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-34add831-9fd5-43bf-899f-babb8dfdf255 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:24.510626 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-34add831-9fd5-43bf-899f-babb8dfdf255 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:24.511124 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-34add831-9fd5-43bf-899f-babb8dfdf255 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:24.511559 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-34add831-9fd5-43bf-899f-babb8dfdf255 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:24.512242 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-34add831-9fd5-43bf-899f-babb8dfdf255 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:24.512692 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-34add831-9fd5-43bf-899f-babb8dfdf255 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:24.513140 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-34add831-9fd5-43bf-899f-babb8dfdf255 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:24.546661 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-34add831-9fd5-43bf-899f-babb8dfdf255 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:24.547271 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-34add831-9fd5-43bf-899f-babb8dfdf255 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:24.547707 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-34add831-9fd5-43bf-899f-babb8dfdf255 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:24.548162 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.objects.instance [None req-34add831-9fd5-43bf-899f-babb8dfdf255 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lazy-loading 'fault' on Instance uuid d835cdc8-620a-46a9-83ce-d47557bf77a9 {{(pid=118915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:13:24.601468 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-34add831-9fd5-43bf-899f-babb8dfdf255 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e637d319f449f38e4d6375ae5b22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c837e1766e0141ea9b868b89efee5ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:24.613402 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-34add831-9fd5-43bf-899f-babb8dfdf255 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 200 len: 1351 microversion: 2.1 time: 0.114316 Oct 24 13:13:24.614626 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 54/120] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:24 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 1351 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:25.144489 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-809a268f-e8d1-408f-a5f6-28e7e37ea93c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:25.145098 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-809a268f-e8d1-408f-a5f6-28e7e37ea93c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:25.147166 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:25.152525 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-809a268f-e8d1-408f-a5f6-28e7e37ea93c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:25.153007 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-809a268f-e8d1-408f-a5f6-28e7e37ea93c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:25.153439 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-809a268f-e8d1-408f-a5f6-28e7e37ea93c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:25.154781 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-809a268f-e8d1-408f-a5f6-28e7e37ea93c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:25.155364 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-809a268f-e8d1-408f-a5f6-28e7e37ea93c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:25.155784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-809a268f-e8d1-408f-a5f6-28e7e37ea93c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:25.282493 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-809a268f-e8d1-408f-a5f6-28e7e37ea93c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:25.290069 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-809a268f-e8d1-408f-a5f6-28e7e37ea93c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.149461 Oct 24 13:13:25.290630 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 67/121] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:25 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:25.637690 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-b451efd5-2d17-408d-8a99-a8cd11a4a71d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:25.638305 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-b451efd5-2d17-408d-8a99-a8cd11a4a71d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:25.645681 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b451efd5-2d17-408d-8a99-a8cd11a4a71d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:25.646253 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b451efd5-2d17-408d-8a99-a8cd11a4a71d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:25.646686 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b451efd5-2d17-408d-8a99-a8cd11a4a71d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:25.647398 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b451efd5-2d17-408d-8a99-a8cd11a4a71d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:25.648110 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b451efd5-2d17-408d-8a99-a8cd11a4a71d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:25.648532 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b451efd5-2d17-408d-8a99-a8cd11a4a71d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:25.707006 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b451efd5-2d17-408d-8a99-a8cd11a4a71d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:25.707234 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b451efd5-2d17-408d-8a99-a8cd11a4a71d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:25.707664 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b451efd5-2d17-408d-8a99-a8cd11a4a71d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:25.708583 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.objects.instance [None req-b451efd5-2d17-408d-8a99-a8cd11a4a71d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lazy-loading 'fault' on Instance uuid d835cdc8-620a-46a9-83ce-d47557bf77a9 {{(pid=118915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:13:25.751799 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-b451efd5-2d17-408d-8a99-a8cd11a4a71d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e637d319f449f38e4d6375ae5b22fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c837e1766e0141ea9b868b89efee5ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:25.760414 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-b451efd5-2d17-408d-8a99-a8cd11a4a71d tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 200 len: 1305 microversion: 2.1 time: 0.126570 Oct 24 13:13:25.761166 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 55/122] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:25 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 1305 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:26.313590 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-6b2d7538-8de9-4496-9234-f75efbf70a2a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:26.314215 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-6b2d7538-8de9-4496-9234-f75efbf70a2a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:26.320168 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6b2d7538-8de9-4496-9234-f75efbf70a2a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:26.320643 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6b2d7538-8de9-4496-9234-f75efbf70a2a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:26.321079 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6b2d7538-8de9-4496-9234-f75efbf70a2a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:26.321752 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6b2d7538-8de9-4496-9234-f75efbf70a2a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:26.322228 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6b2d7538-8de9-4496-9234-f75efbf70a2a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:26.322633 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6b2d7538-8de9-4496-9234-f75efbf70a2a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:26.455935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-6b2d7538-8de9-4496-9234-f75efbf70a2a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:26.463699 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-6b2d7538-8de9-4496-9234-f75efbf70a2a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.154964 Oct 24 13:13:26.464418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 68/123] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:26 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:26.784283 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-51d249ef-fd36-48d9-a4eb-d8c9b98bf98f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:26.785091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-51d249ef-fd36-48d9-a4eb-d8c9b98bf98f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:26.791826 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-51d249ef-fd36-48d9-a4eb-d8c9b98bf98f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:26.792311 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-51d249ef-fd36-48d9-a4eb-d8c9b98bf98f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:26.792750 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-51d249ef-fd36-48d9-a4eb-d8c9b98bf98f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:26.793475 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-51d249ef-fd36-48d9-a4eb-d8c9b98bf98f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:26.793928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-51d249ef-fd36-48d9-a4eb-d8c9b98bf98f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:26.794348 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-51d249ef-fd36-48d9-a4eb-d8c9b98bf98f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:26.808386 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-51d249ef-fd36-48d9-a4eb-d8c9b98bf98f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] HTTP exception thrown: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. Oct 24 13:13:26.813912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-51d249ef-fd36-48d9-a4eb-d8c9b98bf98f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Request method failure captured: Oct 24 13:13:26.813912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 HTTP/1.1 Oct 24 13:13:26.813912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:13:26.813912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:13:26.813912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:13:26.813912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:13:26.813912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:13:26.813912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:13:26.813912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:13:26.813912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:13:26.813912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo8-aN4ghzHlagrmZ3qLIMCEBv-heTn7vTgdMci1aqolXfSF_-S2R0MTLDVRdudfoaBwfDpdsxxnGd3WPwGYi_iwNdsxc2ZBOOwZ2sP1AiTZIHDgxb2xlB5862Tfl79Db0MbQ2uC_1EoYhI9uAXLYvzJZtJZhpXP2-2JlLRo0bHd1y0 Oct 24 13:13:26.813912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:13:26.813912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:13:26.813912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:13:26.813912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:13:26.813912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:13:26.813912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:13:26.813912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: c837e1766e0141ea9b868b89efee5ba1 Oct 24 13:13:26.813912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-DeleteServersTestJSON-94702691 Oct 24 13:13:26.813912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:13:26.813912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:13:26.815488 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c837e1766e0141ea9b868b89efee5ba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c837e1766e0141ea9b868b89efee5ba1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c837e1766e0141ea9b868b89efee5ba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c837e1766e0141ea9b868b89efee5ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:13:26.815488 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-DeleteServersTestJSON-94702691 Oct 24 13:13:26.815488 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: c837e1766e0141ea9b868b89efee5ba1 Oct 24 13:13:26.815488 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-DeleteServersTestJSON-94702691 Oct 24 13:13:26.815488 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-DeleteServersTestJSON-94702691-project Oct 24 13:13:26.815488 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:13:26.815488 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:13:26.815488 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: b3e637d319f449f38e4d6375ae5b22fc Oct 24 13:13:26.815488 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-DeleteServersTestJSON-94702691-project Oct 24 13:13:26.815488 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:13:26.815488 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. Oct 24 13:13:26.815488 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': 'd835cdc8-620a-46a9-83ce-d47557bf77a9'} Oct 24 13:13:26.819642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:13:26.819642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:13:26.819642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:13:26.819642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:13:26.819642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:13:26.819642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:13:26.819642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:13:26.819642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:13:26.819642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:13:26.819642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:13:26.819642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. Oct 24 13:13:26.819642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:13:26.819642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:13:26.819642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:13:26.819642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:13:26.819642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:13:26.819642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:13:26.819642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:13:26.819642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:13:26.819642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:13:26.821001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:13:26.821001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:13:26.821001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:13:26.821001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:13:26.821001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:13:26.821001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:13:26.821001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:13:26.821001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. Oct 24 13:13:26.821001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:13:26.821001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:13:26.821001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:13:26.821001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:13:26.821001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:13:26.821001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:13:26.821001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:13:26.821001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:13:26.821001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. Oct 24 13:13:26.821001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:13:26.822295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-51d249ef-fd36-48d9-a4eb-d8c9b98bf98f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Returning 404 to user: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:13:26.822295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-51d249ef-fd36-48d9-a4eb-d8c9b98bf98f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 404 len: 111 microversion: 2.1 time: 0.035368 Oct 24 13:13:26.822295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 56/124] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:26 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:13:26.931447 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c5e85a81-7591-46c6-bf07-169307ce9811 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:26.933634 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-c5e85a81-7591-46c6-bf07-169307ce9811 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:26.939954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c5e85a81-7591-46c6-bf07-169307ce9811 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:26.940420 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c5e85a81-7591-46c6-bf07-169307ce9811 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:26.940841 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c5e85a81-7591-46c6-bf07-169307ce9811 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:26.941509 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c5e85a81-7591-46c6-bf07-169307ce9811 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:26.941951 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c5e85a81-7591-46c6-bf07-169307ce9811 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:26.942362 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c5e85a81-7591-46c6-bf07-169307ce9811 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:26.955190 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-c5e85a81-7591-46c6-bf07-169307ce9811 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] HTTP exception thrown: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. Oct 24 13:13:26.959184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c5e85a81-7591-46c6-bf07-169307ce9811 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Request method failure captured: Oct 24 13:13:26.959184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9/os-volume_attachments HTTP/1.1 Oct 24 13:13:26.959184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:13:26.959184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:13:26.959184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:13:26.959184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:13:26.959184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:13:26.959184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:13:26.959184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:13:26.959184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:13:26.959184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVo8-aN4ghzHlagrmZ3qLIMCEBv-heTn7vTgdMci1aqolXfSF_-S2R0MTLDVRdudfoaBwfDpdsxxnGd3WPwGYi_iwNdsxc2ZBOOwZ2sP1AiTZIHDgxb2xlB5862Tfl79Db0MbQ2uC_1EoYhI9uAXLYvzJZtJZhpXP2-2JlLRo0bHd1y0 Oct 24 13:13:26.959184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:13:26.959184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:13:26.959184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:13:26.959184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:13:26.959184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:13:26.959184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:13:26.959184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: c837e1766e0141ea9b868b89efee5ba1 Oct 24 13:13:26.959184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-DeleteServersTestJSON-94702691 Oct 24 13:13:26.959184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:13:26.959184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:13:26.960566 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c837e1766e0141ea9b868b89efee5ba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c837e1766e0141ea9b868b89efee5ba1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c837e1766e0141ea9b868b89efee5ba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c837e1766e0141ea9b868b89efee5ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:13:26.960566 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-DeleteServersTestJSON-94702691 Oct 24 13:13:26.960566 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: c837e1766e0141ea9b868b89efee5ba1 Oct 24 13:13:26.960566 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-DeleteServersTestJSON-94702691 Oct 24 13:13:26.960566 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-DeleteServersTestJSON-94702691-project Oct 24 13:13:26.960566 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:13:26.960566 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:13:26.960566 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: b3e637d319f449f38e4d6375ae5b22fc Oct 24 13:13:26.960566 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-DeleteServersTestJSON-94702691-project Oct 24 13:13:26.960566 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:13:26.960566 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. Oct 24 13:13:26.960566 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'server_id': 'd835cdc8-620a-46a9-83ce-d47557bf77a9'} Oct 24 13:13:26.961340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:13:26.961340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:13:26.961340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:13:26.961340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:13:26.961340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:13:26.961340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:13:26.961340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:13:26.961340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:13:26.961340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:13:26.961340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:13:26.961340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. Oct 24 13:13:26.961340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:13:26.961340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:13:26.961340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:13:26.961340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:13:26.961340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:13:26.961340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:13:26.961340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:13:26.961340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:13:26.961340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:13:26.962568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:13:26.962568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 13:13:26.962568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:13:26.962568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 24 13:13:26.962568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:13:26.962568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 24 13:13:26.962568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 24 13:13:26.962568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:13:26.962568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:13:26.962568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. Oct 24 13:13:26.962568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:13:26.962568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:13:26.962568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:13:26.962568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:13:26.962568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:13:26.962568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:13:26.962568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:13:26.962568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:13:26.962568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. Oct 24 13:13:26.962568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:13:26.963851 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c5e85a81-7591-46c6-bf07-169307ce9811 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Returning 404 to user: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:13:26.963851 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-c5e85a81-7591-46c6-bf07-169307ce9811 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032996 Oct 24 13:13:26.963851 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 69/125] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:13:26 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:13:27.486315 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-aae600ca-4b22-4ccd-b4ca-4041176ada84 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:27.486934 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-aae600ca-4b22-4ccd-b4ca-4041176ada84 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:27.492968 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aae600ca-4b22-4ccd-b4ca-4041176ada84 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:27.493441 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aae600ca-4b22-4ccd-b4ca-4041176ada84 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:27.493868 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aae600ca-4b22-4ccd-b4ca-4041176ada84 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:27.494543 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aae600ca-4b22-4ccd-b4ca-4041176ada84 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:27.494987 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aae600ca-4b22-4ccd-b4ca-4041176ada84 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:27.495428 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aae600ca-4b22-4ccd-b4ca-4041176ada84 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:27.627869 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-aae600ca-4b22-4ccd-b4ca-4041176ada84 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:27.635759 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-aae600ca-4b22-4ccd-b4ca-4041176ada84 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.154120 Oct 24 13:13:27.636316 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 57/126] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:27 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:28.658487 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-3a0a57d7-bb76-4c8c-93b0-72ad2f8c05d6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:28.659163 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-3a0a57d7-bb76-4c8c-93b0-72ad2f8c05d6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:28.665269 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3a0a57d7-bb76-4c8c-93b0-72ad2f8c05d6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:28.665751 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3a0a57d7-bb76-4c8c-93b0-72ad2f8c05d6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:28.666193 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3a0a57d7-bb76-4c8c-93b0-72ad2f8c05d6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:28.666873 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3a0a57d7-bb76-4c8c-93b0-72ad2f8c05d6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:28.667353 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3a0a57d7-bb76-4c8c-93b0-72ad2f8c05d6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:28.667792 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3a0a57d7-bb76-4c8c-93b0-72ad2f8c05d6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:28.840357 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-3a0a57d7-bb76-4c8c-93b0-72ad2f8c05d6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:28.852775 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-3a0a57d7-bb76-4c8c-93b0-72ad2f8c05d6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.198124 Oct 24 13:13:28.853351 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 70/127] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:28 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:29.877211 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-6db7af1a-f75d-430f-87ad-4767014e7130 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:29.878083 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-6db7af1a-f75d-430f-87ad-4767014e7130 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:29.885444 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6db7af1a-f75d-430f-87ad-4767014e7130 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:29.885999 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6db7af1a-f75d-430f-87ad-4767014e7130 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:29.886532 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6db7af1a-f75d-430f-87ad-4767014e7130 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:29.887310 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6db7af1a-f75d-430f-87ad-4767014e7130 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:29.887948 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6db7af1a-f75d-430f-87ad-4767014e7130 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:29.889126 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6db7af1a-f75d-430f-87ad-4767014e7130 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:30.077420 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-6db7af1a-f75d-430f-87ad-4767014e7130 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:30.085846 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-6db7af1a-f75d-430f-87ad-4767014e7130 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.212507 Oct 24 13:13:30.087475 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 58/128] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:29 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:30.316746 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c20c6643-b610-4b0f-8a23-7b63caff631f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:30.322621 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-c20c6643-b610-4b0f-8a23-7b63caff631f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:30.333486 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c20c6643-b610-4b0f-8a23-7b63caff631f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:30.336862 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c20c6643-b610-4b0f-8a23-7b63caff631f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:30.337617 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c20c6643-b610-4b0f-8a23-7b63caff631f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:30.338340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c20c6643-b610-4b0f-8a23-7b63caff631f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:30.338813 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c20c6643-b610-4b0f-8a23-7b63caff631f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:30.339291 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c20c6643-b610-4b0f-8a23-7b63caff631f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:30.381978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-c20c6643-b610-4b0f-8a23-7b63caff631f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] HTTP exception thrown: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. Oct 24 13:13:30.381978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c20c6643-b610-4b0f-8a23-7b63caff631f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Request method failure captured: Oct 24 13:13:30.381978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: DELETE /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 HTTP/1.1 Oct 24 13:13:30.381978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:13:30.381978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:13:30.381978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:13:30.381978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:13:30.381978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:13:30.381978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:13:30.381978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:13:30.381978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:13:30.381978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVo8-aN4ghzHlagrmZ3qLIMCEBv-heTn7vTgdMci1aqolXfSF_-S2R0MTLDVRdudfoaBwfDpdsxxnGd3WPwGYi_iwNdsxc2ZBOOwZ2sP1AiTZIHDgxb2xlB5862Tfl79Db0MbQ2uC_1EoYhI9uAXLYvzJZtJZhpXP2-2JlLRo0bHd1y0 Oct 24 13:13:30.381978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:13:30.381978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:13:30.381978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:13:30.381978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:13:30.381978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:13:30.381978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:13:30.381978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: c837e1766e0141ea9b868b89efee5ba1 Oct 24 13:13:30.381978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-DeleteServersTestJSON-94702691 Oct 24 13:13:30.381978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:13:30.381978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:13:30.383295 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c837e1766e0141ea9b868b89efee5ba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c837e1766e0141ea9b868b89efee5ba1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c837e1766e0141ea9b868b89efee5ba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c837e1766e0141ea9b868b89efee5ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:13:30.383295 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-DeleteServersTestJSON-94702691 Oct 24 13:13:30.383295 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: c837e1766e0141ea9b868b89efee5ba1 Oct 24 13:13:30.383295 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-DeleteServersTestJSON-94702691 Oct 24 13:13:30.383295 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-DeleteServersTestJSON-94702691-project Oct 24 13:13:30.383295 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:13:30.383295 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:13:30.383295 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: b3e637d319f449f38e4d6375ae5b22fc Oct 24 13:13:30.383295 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-DeleteServersTestJSON-94702691-project Oct 24 13:13:30.383295 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:13:30.383295 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. Oct 24 13:13:30.383295 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': 'd835cdc8-620a-46a9-83ce-d47557bf77a9'} Oct 24 13:13:30.384077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:13:30.384077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:13:30.384077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:13:30.384077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:13:30.384077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:13:30.384077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:13:30.384077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:13:30.384077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:13:30.384077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:13:30.384077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:13:30.384077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. Oct 24 13:13:30.384077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:13:30.384077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:13:30.384077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:13:30.384077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:13:30.384077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:13:30.384077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:13:30.384077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:13:30.384077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:13:30.384077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:13:30.385562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:13:30.385562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:13:30.385562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:13:30.385562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:13:30.385562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:13:30.385562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:13:30.385562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:13:30.385562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:13:30.385562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:13:30.385562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. Oct 24 13:13:30.385562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:13:30.385562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:13:30.385562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:13:30.385562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:13:30.385562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:13:30.385562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:13:30.385562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:13:30.385562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:13:30.385562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. Oct 24 13:13:30.385562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:13:30.386898 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c20c6643-b610-4b0f-8a23-7b63caff631f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Returning 404 to user: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:13:30.386898 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-c20c6643-b610-4b0f-8a23-7b63caff631f tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 404 len: 111 microversion: 2.1 time: 0.066719 Oct 24 13:13:30.386898 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 71/129] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:13:30 2022] DELETE /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:13:30.387834 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-821b8de1-9d41-4fac-ad41-14d1bb41b1c4 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:30.389403 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-821b8de1-9d41-4fac-ad41-14d1bb41b1c4 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] [instance: d835cdc8-620a-46a9-83ce-d47557bf77a9] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:30.398974 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-821b8de1-9d41-4fac-ad41-14d1bb41b1c4 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:30.399802 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-821b8de1-9d41-4fac-ad41-14d1bb41b1c4 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:30.400238 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-821b8de1-9d41-4fac-ad41-14d1bb41b1c4 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:30.400964 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-821b8de1-9d41-4fac-ad41-14d1bb41b1c4 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:30.401414 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-821b8de1-9d41-4fac-ad41-14d1bb41b1c4 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:30.403198 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-821b8de1-9d41-4fac-ad41-14d1bb41b1c4 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:30.432770 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-821b8de1-9d41-4fac-ad41-14d1bb41b1c4 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] HTTP exception thrown: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. Oct 24 13:13:30.434313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-821b8de1-9d41-4fac-ad41-14d1bb41b1c4 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Request method failure captured: Oct 24 13:13:30.434313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 HTTP/1.1 Oct 24 13:13:30.434313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:13:30.434313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:13:30.434313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:13:30.434313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:13:30.434313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:13:30.434313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:13:30.434313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:13:30.434313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:13:30.434313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo8-aN4ghzHlagrmZ3qLIMCEBv-heTn7vTgdMci1aqolXfSF_-S2R0MTLDVRdudfoaBwfDpdsxxnGd3WPwGYi_iwNdsxc2ZBOOwZ2sP1AiTZIHDgxb2xlB5862Tfl79Db0MbQ2uC_1EoYhI9uAXLYvzJZtJZhpXP2-2JlLRo0bHd1y0 Oct 24 13:13:30.434313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:13:30.434313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:13:30.434313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:13:30.434313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:13:30.434313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:13:30.434313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:13:30.434313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: c837e1766e0141ea9b868b89efee5ba1 Oct 24 13:13:30.434313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-DeleteServersTestJSON-94702691 Oct 24 13:13:30.434313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:13:30.434313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:13:30.435814 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c837e1766e0141ea9b868b89efee5ba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c837e1766e0141ea9b868b89efee5ba1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c837e1766e0141ea9b868b89efee5ba1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c837e1766e0141ea9b868b89efee5ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:13:30.435814 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-DeleteServersTestJSON-94702691 Oct 24 13:13:30.435814 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: c837e1766e0141ea9b868b89efee5ba1 Oct 24 13:13:30.435814 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-DeleteServersTestJSON-94702691 Oct 24 13:13:30.435814 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-DeleteServersTestJSON-94702691-project Oct 24 13:13:30.435814 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:13:30.435814 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:13:30.435814 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: b3e637d319f449f38e4d6375ae5b22fc Oct 24 13:13:30.435814 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-DeleteServersTestJSON-94702691-project Oct 24 13:13:30.435814 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:13:30.435814 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. Oct 24 13:13:30.435814 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': 'd835cdc8-620a-46a9-83ce-d47557bf77a9'} Oct 24 13:13:30.436546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:13:30.436546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:13:30.436546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:13:30.436546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:13:30.436546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:13:30.436546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:13:30.436546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:13:30.436546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:13:30.436546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:13:30.436546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:13:30.436546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. Oct 24 13:13:30.436546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:13:30.436546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:13:30.436546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:13:30.436546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:13:30.436546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:13:30.436546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:13:30.436546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:13:30.436546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:13:30.436546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:13:30.437768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:13:30.437768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:13:30.437768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:13:30.437768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:13:30.437768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:13:30.437768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:13:30.437768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:13:30.437768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. Oct 24 13:13:30.437768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:13:30.437768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:13:30.437768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:13:30.437768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:13:30.437768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:13:30.437768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:13:30.437768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:13:30.437768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:13:30.437768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. Oct 24 13:13:30.437768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:13:30.438939 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-821b8de1-9d41-4fac-ad41-14d1bb41b1c4 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] Returning 404 to user: Instance d835cdc8-620a-46a9-83ce-d47557bf77a9 could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:13:30.438939 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-821b8de1-9d41-4fac-ad41-14d1bb41b1c4 tempest-DeleteServersTestJSON-94702691 tempest-DeleteServersTestJSON-94702691-project] 10.222.0.42 "GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9" status: 404 len: 111 microversion: 2.1 time: 0.052562 Oct 24 13:13:30.438939 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 59/130] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:30 2022] GET /compute/v2.1/servers/d835cdc8-620a-46a9-83ce-d47557bf77a9 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:13:31.115251 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-9a8b05a8-d02b-47b9-94e3-b0b99ebdf86a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:31.117857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-9a8b05a8-d02b-47b9-94e3-b0b99ebdf86a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:31.130574 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9a8b05a8-d02b-47b9-94e3-b0b99ebdf86a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:31.131902 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9a8b05a8-d02b-47b9-94e3-b0b99ebdf86a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:31.141028 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9a8b05a8-d02b-47b9-94e3-b0b99ebdf86a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:31.142155 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9a8b05a8-d02b-47b9-94e3-b0b99ebdf86a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:31.144195 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9a8b05a8-d02b-47b9-94e3-b0b99ebdf86a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:31.144794 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9a8b05a8-d02b-47b9-94e3-b0b99ebdf86a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:31.389224 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-9a8b05a8-d02b-47b9-94e3-b0b99ebdf86a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:31.400039 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-9a8b05a8-d02b-47b9-94e3-b0b99ebdf86a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.294440 Oct 24 13:13:31.401327 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 72/131] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:31 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:13:32.426259 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-030434bb-f6ed-4fd3-b81b-42b50b82de97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:32.427634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-030434bb-f6ed-4fd3-b81b-42b50b82de97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:32.437984 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:SELECT=78 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:32.443610 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-030434bb-f6ed-4fd3-b81b-42b50b82de97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:32.446730 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-030434bb-f6ed-4fd3-b81b-42b50b82de97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:32.447744 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-030434bb-f6ed-4fd3-b81b-42b50b82de97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:32.448683 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-030434bb-f6ed-4fd3-b81b-42b50b82de97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:32.449148 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-030434bb-f6ed-4fd3-b81b-42b50b82de97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:32.451443 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-030434bb-f6ed-4fd3-b81b-42b50b82de97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:32.485874 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=100 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:32.836700 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-030434bb-f6ed-4fd3-b81b-42b50b82de97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:32.852620 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-030434bb-f6ed-4fd3-b81b-42b50b82de97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.425280 Oct 24 13:13:32.853259 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 60/132] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:32 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:33.880490 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-ff54aec8-c26f-4189-bbee-e22934209dea tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:33.881688 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-ff54aec8-c26f-4189-bbee-e22934209dea tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:33.891630 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ff54aec8-c26f-4189-bbee-e22934209dea tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:33.896173 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ff54aec8-c26f-4189-bbee-e22934209dea tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:33.897831 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ff54aec8-c26f-4189-bbee-e22934209dea tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:33.901791 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ff54aec8-c26f-4189-bbee-e22934209dea tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:33.904651 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ff54aec8-c26f-4189-bbee-e22934209dea tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:33.907088 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ff54aec8-c26f-4189-bbee-e22934209dea tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:34.268443 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-ff54aec8-c26f-4189-bbee-e22934209dea tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:34.277722 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-ff54aec8-c26f-4189-bbee-e22934209dea tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.401724 Oct 24 13:13:34.278304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 73/133] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:33 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:35.305724 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8d0bf4bb-92af-46f2-ac1f-2b68be7e558a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:35.307372 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-8d0bf4bb-92af-46f2-ac1f-2b68be7e558a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:35.315134 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8d0bf4bb-92af-46f2-ac1f-2b68be7e558a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:35.317206 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8d0bf4bb-92af-46f2-ac1f-2b68be7e558a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:35.317957 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8d0bf4bb-92af-46f2-ac1f-2b68be7e558a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:35.318929 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8d0bf4bb-92af-46f2-ac1f-2b68be7e558a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:35.319674 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8d0bf4bb-92af-46f2-ac1f-2b68be7e558a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:35.320374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8d0bf4bb-92af-46f2-ac1f-2b68be7e558a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:35.519995 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-8d0bf4bb-92af-46f2-ac1f-2b68be7e558a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:35.539132 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-8d0bf4bb-92af-46f2-ac1f-2b68be7e558a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.237314 Oct 24 13:13:35.542301 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 61/134] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:35 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:36.571031 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-833dec2a-e1c0-4aa6-bdb9-c9c065c1ff60 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:36.572542 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-833dec2a-e1c0-4aa6-bdb9-c9c065c1ff60 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:36.582471 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-833dec2a-e1c0-4aa6-bdb9-c9c065c1ff60 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:36.583247 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-833dec2a-e1c0-4aa6-bdb9-c9c065c1ff60 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:36.583850 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-833dec2a-e1c0-4aa6-bdb9-c9c065c1ff60 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:36.584550 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-833dec2a-e1c0-4aa6-bdb9-c9c065c1ff60 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:36.585151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-833dec2a-e1c0-4aa6-bdb9-c9c065c1ff60 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:36.585723 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-833dec2a-e1c0-4aa6-bdb9-c9c065c1ff60 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:36.759690 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-833dec2a-e1c0-4aa6-bdb9-c9c065c1ff60 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:36.771097 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-833dec2a-e1c0-4aa6-bdb9-c9c065c1ff60 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.210988 Oct 24 13:13:36.772169 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 74/135] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:36 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:37.798057 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-ee6e02e5-746e-4eff-8d1c-e435684c11c4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:37.798828 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-ee6e02e5-746e-4eff-8d1c-e435684c11c4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:37.806036 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ee6e02e5-746e-4eff-8d1c-e435684c11c4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:37.806636 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ee6e02e5-746e-4eff-8d1c-e435684c11c4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:37.807890 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ee6e02e5-746e-4eff-8d1c-e435684c11c4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:37.809222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ee6e02e5-746e-4eff-8d1c-e435684c11c4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:37.809732 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ee6e02e5-746e-4eff-8d1c-e435684c11c4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:37.811330 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ee6e02e5-746e-4eff-8d1c-e435684c11c4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:38.051396 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-ee6e02e5-746e-4eff-8d1c-e435684c11c4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:38.063902 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-ee6e02e5-746e-4eff-8d1c-e435684c11c4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.271950 Oct 24 13:13:38.064699 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 62/136] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:37 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:39.092464 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-dd5ddf41-1801-4656-b9f6-d992ae372bec tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:39.093547 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-dd5ddf41-1801-4656-b9f6-d992ae372bec tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:39.116597 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dd5ddf41-1801-4656-b9f6-d992ae372bec tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:39.120023 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dd5ddf41-1801-4656-b9f6-d992ae372bec tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:39.120796 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dd5ddf41-1801-4656-b9f6-d992ae372bec tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:39.121809 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dd5ddf41-1801-4656-b9f6-d992ae372bec tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:39.122346 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dd5ddf41-1801-4656-b9f6-d992ae372bec tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:39.123938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dd5ddf41-1801-4656-b9f6-d992ae372bec tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:39.436522 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-dd5ddf41-1801-4656-b9f6-d992ae372bec tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:39.446247 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-dd5ddf41-1801-4656-b9f6-d992ae372bec tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.360717 Oct 24 13:13:39.447592 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 75/137] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:39 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:40.471725 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9c647c5d-6422-410e-a7fd-668ec76e8f2d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:40.472490 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9c647c5d-6422-410e-a7fd-668ec76e8f2d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:40.479194 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9c647c5d-6422-410e-a7fd-668ec76e8f2d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:40.479685 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9c647c5d-6422-410e-a7fd-668ec76e8f2d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:40.480121 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9c647c5d-6422-410e-a7fd-668ec76e8f2d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:40.480949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9c647c5d-6422-410e-a7fd-668ec76e8f2d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:40.481411 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9c647c5d-6422-410e-a7fd-668ec76e8f2d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:40.481844 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9c647c5d-6422-410e-a7fd-668ec76e8f2d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:40.671902 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-9c647c5d-6422-410e-a7fd-668ec76e8f2d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:40.680300 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-9c647c5d-6422-410e-a7fd-668ec76e8f2d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.213281 Oct 24 13:13:40.698788 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 63/138] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:40 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:41.706359 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-06b390e9-482a-4331-9b1b-ce3228b2ae2f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:41.707211 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-06b390e9-482a-4331-9b1b-ce3228b2ae2f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:41.713416 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-06b390e9-482a-4331-9b1b-ce3228b2ae2f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:41.714047 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-06b390e9-482a-4331-9b1b-ce3228b2ae2f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:41.714579 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-06b390e9-482a-4331-9b1b-ce3228b2ae2f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:41.715395 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-06b390e9-482a-4331-9b1b-ce3228b2ae2f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:41.715966 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-06b390e9-482a-4331-9b1b-ce3228b2ae2f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:41.716509 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-06b390e9-482a-4331-9b1b-ce3228b2ae2f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:41.941304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-06b390e9-482a-4331-9b1b-ce3228b2ae2f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:41.953797 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-06b390e9-482a-4331-9b1b-ce3228b2ae2f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.251848 Oct 24 13:13:41.957846 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 76/139] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:41 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:42.514851 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-7498d0a7-ef99-4799-8e25-06af21a266a0 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Action: 'create', calling method: .version_select at 0x7fad2894e040>, body: {"keypair": {"name": "tempest-keypair-849369560", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAsa+Sm0xISai9MehNbmK/9C7w1tc/LVSqnxgflAn35qNivWl9MBdZvpHBwV3oh1eDNIUu8mEVXGQWvMhXPXrT/7dvhvzexWVHOoBpOWLF9mfSuPh4jqrs3HBP2YwVGwA=="}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:13:42.530985 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-7498d0a7-ef99-4799-8e25-06af21a266a0 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Getting quotas for project df0bdf3ab29d43e0bf749b9814813e5c. Resources: {'key_pairs'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:13:42.534854 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-7498d0a7-ef99-4799-8e25-06af21a266a0 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Getting quotas for user 3f69df43e6ca4663a9ef819c0331c13d and project df0bdf3ab29d43e0bf749b9814813e5c. Resources: {'key_pairs'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:13:42.559368 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-7498d0a7-ef99-4799-8e25-06af21a266a0 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.167557 Oct 24 13:13:42.560956 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 64/140] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Oct 24 13:13:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:13:42.986546 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-248d5ee8-e1b0-4940-bb78-f954bae364ce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:42.987658 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-248d5ee8-e1b0-4940-bb78-f954bae364ce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:42.995811 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-248d5ee8-e1b0-4940-bb78-f954bae364ce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:42.996523 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-248d5ee8-e1b0-4940-bb78-f954bae364ce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:42.998944 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-248d5ee8-e1b0-4940-bb78-f954bae364ce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:43.000121 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-248d5ee8-e1b0-4940-bb78-f954bae364ce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:43.001794 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-248d5ee8-e1b0-4940-bb78-f954bae364ce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:43.002508 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-248d5ee8-e1b0-4940-bb78-f954bae364ce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:43.454054 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-248d5ee8-e1b0-4940-bb78-f954bae364ce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:43.464595 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-248d5ee8-e1b0-4940-bb78-f954bae364ce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.487010 Oct 24 13:13:43.466608 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 77/141] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:42 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:44.162720 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-54bc46ac-6867-4469-bf9f-196a20894195 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-502290180", "imageRef": "4d2e5f3e-4aee-48d2-8ada-0b420d141f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99f0061f-b4ea-47ba-a8ca-587da29d9acf"}], "security_groups": [{"name": "tempest-securitygroup--1006377683"}], "key_name": "tempest-keypair-849369560", "user_data": "}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:13:44.270702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.network.neutron [None req-54bc46ac-6867-4469-bf9f-196a20894195 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] validate_networks() for [('99f0061f-b4ea-47ba-a8ca-587da29d9acf', None, None, None, None, None)] {{(pid=118915) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:13:44.495360 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-2c1b39e1-7641-48d2-829f-230b94caf6d9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:44.497440 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-2c1b39e1-7641-48d2-829f-230b94caf6d9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:44.504378 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2c1b39e1-7641-48d2-829f-230b94caf6d9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:44.504949 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2c1b39e1-7641-48d2-829f-230b94caf6d9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:44.505476 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2c1b39e1-7641-48d2-829f-230b94caf6d9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:44.506348 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2c1b39e1-7641-48d2-829f-230b94caf6d9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:44.506860 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2c1b39e1-7641-48d2-829f-230b94caf6d9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:44.507362 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2c1b39e1-7641-48d2-829f-230b94caf6d9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:44.665508 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-2c1b39e1-7641-48d2-829f-230b94caf6d9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:44.674056 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-2c1b39e1-7641-48d2-829f-230b94caf6d9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.184699 Oct 24 13:13:44.686838 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-54bc46ac-6867-4469-bf9f-196a20894195 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Flavor limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:13:44.686838 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-54bc46ac-6867-4469-bf9f-196a20894195 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Image limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:13:44.686838 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-54bc46ac-6867-4469-bf9f-196a20894195 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Flavor pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:13:44.686838 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-54bc46ac-6867-4469-bf9f-196a20894195 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Image pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:13:44.686838 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-54bc46ac-6867-4469-bf9f-196a20894195 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:13:44.687889 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 78/142] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:44 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:13:44.690834 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-54bc46ac-6867-4469-bf9f-196a20894195 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:44.691430 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-54bc46ac-6867-4469-bf9f-196a20894195 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:44.691917 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-54bc46ac-6867-4469-bf9f-196a20894195 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:44.692725 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-54bc46ac-6867-4469-bf9f-196a20894195 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:44.693244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-54bc46ac-6867-4469-bf9f-196a20894195 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:44.693734 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-54bc46ac-6867-4469-bf9f-196a20894195 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:44.711453 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-54bc46ac-6867-4469-bf9f-196a20894195 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Getting quotas for project df0bdf3ab29d43e0bf749b9814813e5c. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:13:44.715601 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-54bc46ac-6867-4469-bf9f-196a20894195 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Getting quotas for user 3f69df43e6ca4663a9ef819c0331c13d and project df0bdf3ab29d43e0bf749b9814813e5c. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:13:44.727238 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-54bc46ac-6867-4469-bf9f-196a20894195 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Going to run 1 instances... {{(pid=118915) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:13:44.729537 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-54bc46ac-6867-4469-bf9f-196a20894195 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4d2e5f3e-4aee-48d2-8ada-0b420d141f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:13:44.777185 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-54bc46ac-6867-4469-bf9f-196a20894195 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.619248 Oct 24 13:13:44.778207 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 65/143] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 24 13:13:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:13:44.789542 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-78df3ec7-2092-4576-bf0d-f9c6729a5cf1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:44.790150 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-78df3ec7-2092-4576-bf0d-f9c6729a5cf1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:44.849013 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-78df3ec7-2092-4576-bf0d-f9c6729a5cf1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:44.859325 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-78df3ec7-2092-4576-bf0d-f9c6729a5cf1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1236 microversion: 2.1 time: 0.073437 Oct 24 13:13:44.859908 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 79/144] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:44 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1236 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:13:45.697934 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-1ca77520-19ac-43d7-89be-fbafc605e8cc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:45.698637 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-1ca77520-19ac-43d7-89be-fbafc605e8cc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:45.706408 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1ca77520-19ac-43d7-89be-fbafc605e8cc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:45.706992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1ca77520-19ac-43d7-89be-fbafc605e8cc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:45.707637 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1ca77520-19ac-43d7-89be-fbafc605e8cc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:45.708567 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1ca77520-19ac-43d7-89be-fbafc605e8cc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:45.709096 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1ca77520-19ac-43d7-89be-fbafc605e8cc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:45.709789 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1ca77520-19ac-43d7-89be-fbafc605e8cc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:45.857584 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-1ca77520-19ac-43d7-89be-fbafc605e8cc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:45.865824 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-1ca77520-19ac-43d7-89be-fbafc605e8cc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.172234 Oct 24 13:13:45.866434 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 66/145] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:45 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:45.884711 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-53aca6bd-822c-4b2f-8361-d756248bb728 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:45.885692 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-53aca6bd-822c-4b2f-8361-d756248bb728 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:45.893335 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-53aca6bd-822c-4b2f-8361-d756248bb728 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:45.893896 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-53aca6bd-822c-4b2f-8361-d756248bb728 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:45.894392 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-53aca6bd-822c-4b2f-8361-d756248bb728 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:45.895344 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-53aca6bd-822c-4b2f-8361-d756248bb728 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:45.895873 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-53aca6bd-822c-4b2f-8361-d756248bb728 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:45.896377 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-53aca6bd-822c-4b2f-8361-d756248bb728 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:45.962749 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-53aca6bd-822c-4b2f-8361-d756248bb728 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:45.973667 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-53aca6bd-822c-4b2f-8361-d756248bb728 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1240 microversion: 2.1 time: 0.095616 Oct 24 13:13:45.982775 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 80/146] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:45 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1240 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:46.890626 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-5e2bf5e6-5499-4dd7-a809-43655c3fce47 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:46.891188 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-5e2bf5e6-5499-4dd7-a809-43655c3fce47 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:46.897493 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5e2bf5e6-5499-4dd7-a809-43655c3fce47 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:46.897963 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5e2bf5e6-5499-4dd7-a809-43655c3fce47 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:46.898395 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5e2bf5e6-5499-4dd7-a809-43655c3fce47 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:46.899079 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5e2bf5e6-5499-4dd7-a809-43655c3fce47 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:46.899543 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5e2bf5e6-5499-4dd7-a809-43655c3fce47 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:46.899959 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5e2bf5e6-5499-4dd7-a809-43655c3fce47 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:47.000329 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d9ac1181-7a6c-4f04-9d2c-f79cfbeeb908 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:47.003866 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-d9ac1181-7a6c-4f04-9d2c-f79cfbeeb908 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:47.011144 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d9ac1181-7a6c-4f04-9d2c-f79cfbeeb908 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:47.011931 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d9ac1181-7a6c-4f04-9d2c-f79cfbeeb908 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:47.012569 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d9ac1181-7a6c-4f04-9d2c-f79cfbeeb908 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:47.013476 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d9ac1181-7a6c-4f04-9d2c-f79cfbeeb908 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:47.014134 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d9ac1181-7a6c-4f04-9d2c-f79cfbeeb908 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:47.014761 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d9ac1181-7a6c-4f04-9d2c-f79cfbeeb908 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:47.070951 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-5e2bf5e6-5499-4dd7-a809-43655c3fce47 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:47.079556 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-5e2bf5e6-5499-4dd7-a809-43655c3fce47 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.193253 Oct 24 13:13:47.082021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 67/147] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:46 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:47.136999 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-d9ac1181-7a6c-4f04-9d2c-f79cfbeeb908 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:47.145212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-d9ac1181-7a6c-4f04-9d2c-f79cfbeeb908 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1296 microversion: 2.1 time: 0.151389 Oct 24 13:13:47.146010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 81/148] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:46 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1296 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:48.105438 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-d6e97f55-f607-4eea-9bd0-3fe62c572a0e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:48.106226 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-d6e97f55-f607-4eea-9bd0-3fe62c572a0e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:48.113532 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d6e97f55-f607-4eea-9bd0-3fe62c572a0e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:48.114016 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d6e97f55-f607-4eea-9bd0-3fe62c572a0e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:48.114444 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d6e97f55-f607-4eea-9bd0-3fe62c572a0e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:48.115193 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d6e97f55-f607-4eea-9bd0-3fe62c572a0e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:48.115649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d6e97f55-f607-4eea-9bd0-3fe62c572a0e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:48.116072 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d6e97f55-f607-4eea-9bd0-3fe62c572a0e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:48.175128 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-dd6790e1-cf1e-4501-99af-0f881955b8ec tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:48.175740 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-dd6790e1-cf1e-4501-99af-0f881955b8ec tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:48.181824 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dd6790e1-cf1e-4501-99af-0f881955b8ec tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:48.182311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dd6790e1-cf1e-4501-99af-0f881955b8ec tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:48.182743 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dd6790e1-cf1e-4501-99af-0f881955b8ec tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:48.183470 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dd6790e1-cf1e-4501-99af-0f881955b8ec tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:48.183933 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dd6790e1-cf1e-4501-99af-0f881955b8ec tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:48.184358 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dd6790e1-cf1e-4501-99af-0f881955b8ec tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:48.256137 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-d6e97f55-f607-4eea-9bd0-3fe62c572a0e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:48.266641 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-d6e97f55-f607-4eea-9bd0-3fe62c572a0e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.164866 Oct 24 13:13:48.267231 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 68/149] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:48 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:48.333426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-dd6790e1-cf1e-4501-99af-0f881955b8ec tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:48.336840 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=100 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:48.342338 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-dd6790e1-cf1e-4501-99af-0f881955b8ec tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1362 microversion: 2.1 time: 0.171075 Oct 24 13:13:48.342890 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 82/150] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:48 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:49.290401 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-888b8e89-e30f-4ee7-be4e-5df42b0bc5de tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:49.290943 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-888b8e89-e30f-4ee7-be4e-5df42b0bc5de tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:49.298400 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-888b8e89-e30f-4ee7-be4e-5df42b0bc5de tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:49.298882 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-888b8e89-e30f-4ee7-be4e-5df42b0bc5de tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:49.299380 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-888b8e89-e30f-4ee7-be4e-5df42b0bc5de tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:49.300075 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-888b8e89-e30f-4ee7-be4e-5df42b0bc5de tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:49.300528 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-888b8e89-e30f-4ee7-be4e-5df42b0bc5de tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:49.300949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-888b8e89-e30f-4ee7-be4e-5df42b0bc5de tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:49.365428 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-8c9101fc-ccd8-426f-aefd-608d0d7e9791 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:49.366049 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-8c9101fc-ccd8-426f-aefd-608d0d7e9791 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:49.372738 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8c9101fc-ccd8-426f-aefd-608d0d7e9791 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:49.373237 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8c9101fc-ccd8-426f-aefd-608d0d7e9791 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:49.373711 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8c9101fc-ccd8-426f-aefd-608d0d7e9791 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:49.374406 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8c9101fc-ccd8-426f-aefd-608d0d7e9791 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:49.374860 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8c9101fc-ccd8-426f-aefd-608d0d7e9791 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:49.375306 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8c9101fc-ccd8-426f-aefd-608d0d7e9791 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:49.438498 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-888b8e89-e30f-4ee7-be4e-5df42b0bc5de tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:49.446196 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-888b8e89-e30f-4ee7-be4e-5df42b0bc5de tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.159739 Oct 24 13:13:49.446942 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 69/151] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:49 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:49.594182 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-8c9101fc-ccd8-426f-aefd-608d0d7e9791 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:49.601851 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-8c9101fc-ccd8-426f-aefd-608d0d7e9791 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1362 microversion: 2.1 time: 0.240570 Oct 24 13:13:49.602529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 83/152] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:49 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:13:50.124448 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-cea6a188-acf9-4888-878c-4828fa766099 req-39601443-8421-4315-a6a0-a30723626f78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29f8f878-fe8d-4dd0-9478-268c08885faf", "tag": "693064f5-7b97-41dc-8a3f-8c6ce5d17036"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:13:50.133724 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-cea6a188-acf9-4888-878c-4828fa766099 req-39601443-8421-4315-a6a0-a30723626f78 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:50.134195 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-cea6a188-acf9-4888-878c-4828fa766099 req-39601443-8421-4315-a6a0-a30723626f78 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:50.134619 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-cea6a188-acf9-4888-878c-4828fa766099 req-39601443-8421-4315-a6a0-a30723626f78 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:50.145653 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-cea6a188-acf9-4888-878c-4828fa766099 req-39601443-8421-4315-a6a0-a30723626f78 service nova] Creating event network-changed:693064f5-7b97-41dc-8a3f-8c6ce5d17036 for instance 29f8f878-fe8d-4dd0-9478-268c08885faf on hv-cinder-86248 Oct 24 13:13:50.150559 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-cea6a188-acf9-4888-878c-4828fa766099 req-39601443-8421-4315-a6a0-a30723626f78 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030739 Oct 24 13:13:50.151171 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 70/153] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:13:50.470535 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-e7716044-407f-4264-88c1-e3c5af01cac9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:50.471276 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-e7716044-407f-4264-88c1-e3c5af01cac9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:50.477656 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e7716044-407f-4264-88c1-e3c5af01cac9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:50.478222 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e7716044-407f-4264-88c1-e3c5af01cac9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:50.478700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e7716044-407f-4264-88c1-e3c5af01cac9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:50.479434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e7716044-407f-4264-88c1-e3c5af01cac9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:50.479882 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e7716044-407f-4264-88c1-e3c5af01cac9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:50.480294 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e7716044-407f-4264-88c1-e3c5af01cac9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:50.626646 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-0fc95551-f0b4-4f95-ac79-412db18a9219 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:50.627385 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-0fc95551-f0b4-4f95-ac79-412db18a9219 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:50.634062 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0fc95551-f0b4-4f95-ac79-412db18a9219 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:50.634591 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0fc95551-f0b4-4f95-ac79-412db18a9219 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:50.635373 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0fc95551-f0b4-4f95-ac79-412db18a9219 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:50.636209 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0fc95551-f0b4-4f95-ac79-412db18a9219 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:50.636704 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0fc95551-f0b4-4f95-ac79-412db18a9219 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:50.637162 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0fc95551-f0b4-4f95-ac79-412db18a9219 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:50.797546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-0fc95551-f0b4-4f95-ac79-412db18a9219 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:50.805087 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-0fc95551-f0b4-4f95-ac79-412db18a9219 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1362 microversion: 2.1 time: 0.183925 Oct 24 13:13:50.805655 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 71/154] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:50 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:13:50.962715 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-e7716044-407f-4264-88c1-e3c5af01cac9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:50.972198 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-e7716044-407f-4264-88c1-e3c5af01cac9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.506120 Oct 24 13:13:50.972882 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 84/155] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:50 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:51.834143 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-5f373db6-dffe-4a5c-9723-a28677036b0d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:51.834664 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-5f373db6-dffe-4a5c-9723-a28677036b0d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:51.844550 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5f373db6-dffe-4a5c-9723-a28677036b0d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:51.845221 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5f373db6-dffe-4a5c-9723-a28677036b0d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:51.846231 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5f373db6-dffe-4a5c-9723-a28677036b0d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:51.848095 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5f373db6-dffe-4a5c-9723-a28677036b0d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:51.849146 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5f373db6-dffe-4a5c-9723-a28677036b0d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:51.849984 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5f373db6-dffe-4a5c-9723-a28677036b0d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:51.998751 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-839ba995-839a-4309-888c-1b58e5c5b20b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:52.000889 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-839ba995-839a-4309-888c-1b58e5c5b20b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:52.015763 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-839ba995-839a-4309-888c-1b58e5c5b20b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:52.015763 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-839ba995-839a-4309-888c-1b58e5c5b20b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:52.016016 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-839ba995-839a-4309-888c-1b58e5c5b20b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:52.016989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-839ba995-839a-4309-888c-1b58e5c5b20b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:52.017441 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-839ba995-839a-4309-888c-1b58e5c5b20b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:52.017856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-839ba995-839a-4309-888c-1b58e5c5b20b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:52.057587 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-5f373db6-dffe-4a5c-9723-a28677036b0d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:52.083614 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-5f373db6-dffe-4a5c-9723-a28677036b0d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1362 microversion: 2.1 time: 0.242954 Oct 24 13:13:52.085386 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 72/156] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:51 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:52.233118 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-839ba995-839a-4309-888c-1b58e5c5b20b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:52.241593 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-839ba995-839a-4309-888c-1b58e5c5b20b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.249471 Oct 24 13:13:52.242482 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 85/157] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:51 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:13:53.109961 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-03f1ce32-5bf9-482d-90c7-e1a4f59ab95e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:53.110565 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-03f1ce32-5bf9-482d-90c7-e1a4f59ab95e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:53.117505 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-03f1ce32-5bf9-482d-90c7-e1a4f59ab95e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:53.117986 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-03f1ce32-5bf9-482d-90c7-e1a4f59ab95e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:53.118421 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-03f1ce32-5bf9-482d-90c7-e1a4f59ab95e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:53.119128 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-03f1ce32-5bf9-482d-90c7-e1a4f59ab95e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:53.119582 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-03f1ce32-5bf9-482d-90c7-e1a4f59ab95e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:53.120005 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-03f1ce32-5bf9-482d-90c7-e1a4f59ab95e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:53.263774 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-03f1ce32-5bf9-482d-90c7-e1a4f59ab95e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:53.268018 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-6aaa2dae-fcaf-4f5c-94c8-795b8631bff6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:53.268716 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-6aaa2dae-fcaf-4f5c-94c8-795b8631bff6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:53.271545 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-03f1ce32-5bf9-482d-90c7-e1a4f59ab95e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1362 microversion: 2.1 time: 0.165789 Oct 24 13:13:53.275342 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6aaa2dae-fcaf-4f5c-94c8-795b8631bff6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:53.275830 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6aaa2dae-fcaf-4f5c-94c8-795b8631bff6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:53.276289 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6aaa2dae-fcaf-4f5c-94c8-795b8631bff6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:53.277580 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6aaa2dae-fcaf-4f5c-94c8-795b8631bff6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:53.278064 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6aaa2dae-fcaf-4f5c-94c8-795b8631bff6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:53.278488 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6aaa2dae-fcaf-4f5c-94c8-795b8631bff6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:53.287667 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 73/158] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:53 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:53.423788 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-6aaa2dae-fcaf-4f5c-94c8-795b8631bff6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:53.431767 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-6aaa2dae-fcaf-4f5c-94c8-795b8631bff6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.169806 Oct 24 13:13:53.432328 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 86/159] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:53 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:13:54.294820 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-01cfb255-86b5-46a9-bbce-ce81ee82e98a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:54.295573 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-01cfb255-86b5-46a9-bbce-ce81ee82e98a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:54.302078 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-01cfb255-86b5-46a9-bbce-ce81ee82e98a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:54.302749 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-01cfb255-86b5-46a9-bbce-ce81ee82e98a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:54.303203 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-01cfb255-86b5-46a9-bbce-ce81ee82e98a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:54.303891 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-01cfb255-86b5-46a9-bbce-ce81ee82e98a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:54.304336 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-01cfb255-86b5-46a9-bbce-ce81ee82e98a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:54.304746 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-01cfb255-86b5-46a9-bbce-ce81ee82e98a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:54.456544 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a49066be-d343-4629-81bb-1bdf5afe3d3c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:54.457341 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a49066be-d343-4629-81bb-1bdf5afe3d3c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:54.460896 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-01cfb255-86b5-46a9-bbce-ce81ee82e98a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:54.464973 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a49066be-d343-4629-81bb-1bdf5afe3d3c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:54.465704 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a49066be-d343-4629-81bb-1bdf5afe3d3c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:54.467153 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a49066be-d343-4629-81bb-1bdf5afe3d3c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:54.467859 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a49066be-d343-4629-81bb-1bdf5afe3d3c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:54.468471 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a49066be-d343-4629-81bb-1bdf5afe3d3c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:54.469072 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a49066be-d343-4629-81bb-1bdf5afe3d3c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:54.469622 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-01cfb255-86b5-46a9-bbce-ce81ee82e98a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1362 microversion: 2.1 time: 0.179080 Oct 24 13:13:54.470196 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 74/160] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:54 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:54.634327 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a49066be-d343-4629-81bb-1bdf5afe3d3c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:54.644007 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a49066be-d343-4629-81bb-1bdf5afe3d3c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1522 microversion: 2.1 time: 0.191482 Oct 24 13:13:54.644443 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 87/161] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:54 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:13:55.494073 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-6df92e88-ecf0-4738-a432-ca8352126a06 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:55.494657 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-6df92e88-ecf0-4738-a432-ca8352126a06 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:55.496728 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=2 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:55.498079 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=10 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:55.510693 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6df92e88-ecf0-4738-a432-ca8352126a06 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:55.511259 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6df92e88-ecf0-4738-a432-ca8352126a06 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:55.511705 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6df92e88-ecf0-4738-a432-ca8352126a06 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:55.512429 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6df92e88-ecf0-4738-a432-ca8352126a06 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:55.513072 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6df92e88-ecf0-4738-a432-ca8352126a06 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:55.513452 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6df92e88-ecf0-4738-a432-ca8352126a06 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:55.670795 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-b06973bd-6fda-48e0-80c5-6b52a8251b5f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:55.672484 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-b06973bd-6fda-48e0-80c5-6b52a8251b5f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:55.674562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=2 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:55.677865 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=44 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:55.689321 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-6df92e88-ecf0-4738-a432-ca8352126a06 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:55.692360 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b06973bd-6fda-48e0-80c5-6b52a8251b5f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:55.693627 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b06973bd-6fda-48e0-80c5-6b52a8251b5f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:55.694978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b06973bd-6fda-48e0-80c5-6b52a8251b5f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:55.695872 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b06973bd-6fda-48e0-80c5-6b52a8251b5f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:55.696400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b06973bd-6fda-48e0-80c5-6b52a8251b5f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:55.696825 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b06973bd-6fda-48e0-80c5-6b52a8251b5f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:55.716878 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-6df92e88-ecf0-4738-a432-ca8352126a06 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1362 microversion: 2.1 time: 0.226844 Oct 24 13:13:55.717462 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 75/162] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:55 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:55.762922 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-db9348d5-6357-44a8-914c-00c961200794 req-af5591d0-81b7-40c3-a504-cfa03b9aa7c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29f8f878-fe8d-4dd0-9478-268c08885faf", "name": "network-vif-plugged", "status": "completed", "tag": "693064f5-7b97-41dc-8a3f-8c6ce5d17036"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:13:55.780040 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-db9348d5-6357-44a8-914c-00c961200794 req-af5591d0-81b7-40c3-a504-cfa03b9aa7c1 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:55.780525 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-db9348d5-6357-44a8-914c-00c961200794 req-af5591d0-81b7-40c3-a504-cfa03b9aa7c1 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:55.780931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-db9348d5-6357-44a8-914c-00c961200794 req-af5591d0-81b7-40c3-a504-cfa03b9aa7c1 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:55.815747 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-db9348d5-6357-44a8-914c-00c961200794 req-af5591d0-81b7-40c3-a504-cfa03b9aa7c1 service nova] Creating event network-vif-plugged:693064f5-7b97-41dc-8a3f-8c6ce5d17036 for instance 29f8f878-fe8d-4dd0-9478-268c08885faf on hv-cinder-86248 Oct 24 13:13:55.826773 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-db9348d5-6357-44a8-914c-00c961200794 req-af5591d0-81b7-40c3-a504-cfa03b9aa7c1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066557 Oct 24 13:13:55.827706 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 76/163] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:13:55.928409 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-b06973bd-6fda-48e0-80c5-6b52a8251b5f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:55.940068 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-b06973bd-6fda-48e0-80c5-6b52a8251b5f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1502 microversion: 2.1 time: 0.274119 Oct 24 13:13:55.940954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 88/164] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:55 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1502 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:13:55.965467 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-0f8de0c4-06dc-4c97-9c3e-a2ed407bcf21 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:55.966923 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-0f8de0c4-06dc-4c97-9c3e-a2ed407bcf21 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:55.973443 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f8de0c4-06dc-4c97-9c3e-a2ed407bcf21 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:55.974133 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f8de0c4-06dc-4c97-9c3e-a2ed407bcf21 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:55.974783 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f8de0c4-06dc-4c97-9c3e-a2ed407bcf21 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:55.975671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f8de0c4-06dc-4c97-9c3e-a2ed407bcf21 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:55.976195 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f8de0c4-06dc-4c97-9c3e-a2ed407bcf21 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:55.976595 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f8de0c4-06dc-4c97-9c3e-a2ed407bcf21 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:56.129218 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-0f8de0c4-06dc-4c97-9c3e-a2ed407bcf21 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:56.137501 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-0f8de0c4-06dc-4c97-9c3e-a2ed407bcf21 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1516 microversion: 2.1 time: 0.176726 Oct 24 13:13:56.138699 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 77/165] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:55 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:56.745712 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-47ae744e-05ad-4a5f-9e67-d938e8d6e379 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:56.747820 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-47ae744e-05ad-4a5f-9e67-d938e8d6e379 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:56.754659 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-47ae744e-05ad-4a5f-9e67-d938e8d6e379 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:56.755108 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-47ae744e-05ad-4a5f-9e67-d938e8d6e379 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:56.755644 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-47ae744e-05ad-4a5f-9e67-d938e8d6e379 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:56.756381 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-47ae744e-05ad-4a5f-9e67-d938e8d6e379 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:56.756920 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-47ae744e-05ad-4a5f-9e67-d938e8d6e379 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:56.757561 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-47ae744e-05ad-4a5f-9e67-d938e8d6e379 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:56.905067 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-47ae744e-05ad-4a5f-9e67-d938e8d6e379 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:56.912649 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-47ae744e-05ad-4a5f-9e67-d938e8d6e379 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1362 microversion: 2.1 time: 0.170754 Oct 24 13:13:56.913206 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 89/166] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:56 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:57.627284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9cbc354c-e9f1-4fbd-a2c5-6b64f1313d6c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:13:57.629509 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9cbc354c-e9f1-4fbd-a2c5-6b64f1313d6c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:57.636573 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9cbc354c-e9f1-4fbd-a2c5-6b64f1313d6c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:57.637059 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9cbc354c-e9f1-4fbd-a2c5-6b64f1313d6c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:57.637491 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9cbc354c-e9f1-4fbd-a2c5-6b64f1313d6c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:57.639002 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9cbc354c-e9f1-4fbd-a2c5-6b64f1313d6c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:57.639492 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9cbc354c-e9f1-4fbd-a2c5-6b64f1313d6c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:57.639916 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9cbc354c-e9f1-4fbd-a2c5-6b64f1313d6c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:57.663698 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.objects.instance [None req-9cbc354c-e9f1-4fbd-a2c5-6b64f1313d6c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lazy-loading 'flavor' on Instance uuid 2011f5ea-73ab-457d-be16-25ad031e5e96 {{(pid=118915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:13:57.760682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:13:57.939397 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-680c002e-e53c-4f3d-a7c7-55d8ccb9788e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:57.940005 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-680c002e-e53c-4f3d-a7c7-55d8ccb9788e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:57.946658 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-680c002e-e53c-4f3d-a7c7-55d8ccb9788e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:57.947615 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-680c002e-e53c-4f3d-a7c7-55d8ccb9788e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:57.948361 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-680c002e-e53c-4f3d-a7c7-55d8ccb9788e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:57.949779 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-680c002e-e53c-4f3d-a7c7-55d8ccb9788e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:57.951594 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-680c002e-e53c-4f3d-a7c7-55d8ccb9788e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:57.952550 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-680c002e-e53c-4f3d-a7c7-55d8ccb9788e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:58.059621 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-9cbc354c-e9f1-4fbd-a2c5-6b64f1313d6c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "POST /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96/action" status: 200 len: 32 microversion: 2.1 time: 0.438673 Oct 24 13:13:58.060786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 78/167] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 24 13:13:57 2022] POST /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96/action => generated 32 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:13:58.082714 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-5d6f2a3d-1396-4502-9e92-deeb98816546 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:58.085145 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-5d6f2a3d-1396-4502-9e92-deeb98816546 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:58.140689 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5d6f2a3d-1396-4502-9e92-deeb98816546 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:58.147349 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5d6f2a3d-1396-4502-9e92-deeb98816546 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:58.150903 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5d6f2a3d-1396-4502-9e92-deeb98816546 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:58.153326 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5d6f2a3d-1396-4502-9e92-deeb98816546 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:58.157557 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5d6f2a3d-1396-4502-9e92-deeb98816546 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:58.159033 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5d6f2a3d-1396-4502-9e92-deeb98816546 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:58.216190 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-680c002e-e53c-4f3d-a7c7-55d8ccb9788e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:58.231327 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-680c002e-e53c-4f3d-a7c7-55d8ccb9788e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1362 microversion: 2.1 time: 0.297123 Oct 24 13:13:58.232675 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 90/168] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:57 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:13:58.408892 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-5d6f2a3d-1396-4502-9e92-deeb98816546 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:58.424562 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-5d6f2a3d-1396-4502-9e92-deeb98816546 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.355682 Oct 24 13:13:58.426177 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 79/169] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:58 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:59.256075 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a489c4f8-4b6b-41eb-9cf9-cc7c944751b6 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:59.256700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a489c4f8-4b6b-41eb-9cf9-cc7c944751b6 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:59.263775 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a489c4f8-4b6b-41eb-9cf9-cc7c944751b6 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:59.264461 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a489c4f8-4b6b-41eb-9cf9-cc7c944751b6 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:59.264893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a489c4f8-4b6b-41eb-9cf9-cc7c944751b6 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:59.266038 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a489c4f8-4b6b-41eb-9cf9-cc7c944751b6 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:59.266689 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a489c4f8-4b6b-41eb-9cf9-cc7c944751b6 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:59.267137 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a489c4f8-4b6b-41eb-9cf9-cc7c944751b6 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:59.411086 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a489c4f8-4b6b-41eb-9cf9-cc7c944751b6 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:59.422240 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a489c4f8-4b6b-41eb-9cf9-cc7c944751b6 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1549 microversion: 2.1 time: 0.170093 Oct 24 13:13:59.422967 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 91/170] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:59 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1549 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:13:59.445908 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-d8bbc4a4-7cfc-47d8-95ce-287f405f31b9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:59.446444 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-d8bbc4a4-7cfc-47d8-95ce-287f405f31b9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:59.453180 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-2a33a2a6-70d4-4ff7-beb9-00f0c8fedf99 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:13:59.454242 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-2a33a2a6-70d4-4ff7-beb9-00f0c8fedf99 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:13:59.457447 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d8bbc4a4-7cfc-47d8-95ce-287f405f31b9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:59.457925 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d8bbc4a4-7cfc-47d8-95ce-287f405f31b9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:59.458521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d8bbc4a4-7cfc-47d8-95ce-287f405f31b9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:59.459425 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d8bbc4a4-7cfc-47d8-95ce-287f405f31b9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:59.460017 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d8bbc4a4-7cfc-47d8-95ce-287f405f31b9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:59.460636 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d8bbc4a4-7cfc-47d8-95ce-287f405f31b9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:59.460767 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2a33a2a6-70d4-4ff7-beb9-00f0c8fedf99 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:59.461175 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2a33a2a6-70d4-4ff7-beb9-00f0c8fedf99 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:59.461610 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2a33a2a6-70d4-4ff7-beb9-00f0c8fedf99 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:59.462327 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2a33a2a6-70d4-4ff7-beb9-00f0c8fedf99 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:13:59.462778 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2a33a2a6-70d4-4ff7-beb9-00f0c8fedf99 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:13:59.463231 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2a33a2a6-70d4-4ff7-beb9-00f0c8fedf99 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:13:59.564134 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-d8bbc4a4-7cfc-47d8-95ce-287f405f31b9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123047 Oct 24 13:13:59.564828 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 80/171] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Oct 24 13:13:59 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:13:59.782753 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-2a33a2a6-70d4-4ff7-beb9-00f0c8fedf99 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:13:59.791417 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-2a33a2a6-70d4-4ff7-beb9-00f0c8fedf99 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.342953 Oct 24 13:13:59.803783 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 92/172] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:13:59 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:00.816914 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-b36be10a-0ae2-44fd-bf29-59a8bd287eac tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:00.817819 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-b36be10a-0ae2-44fd-bf29-59a8bd287eac tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:00.824025 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b36be10a-0ae2-44fd-bf29-59a8bd287eac tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:00.824589 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b36be10a-0ae2-44fd-bf29-59a8bd287eac tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:00.825845 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b36be10a-0ae2-44fd-bf29-59a8bd287eac tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:00.826550 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b36be10a-0ae2-44fd-bf29-59a8bd287eac tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:00.827008 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b36be10a-0ae2-44fd-bf29-59a8bd287eac tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:00.827650 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b36be10a-0ae2-44fd-bf29-59a8bd287eac tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:00.971744 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-b36be10a-0ae2-44fd-bf29-59a8bd287eac tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:00.980969 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-b36be10a-0ae2-44fd-bf29-59a8bd287eac tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.168633 Oct 24 13:14:00.982361 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 81/173] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:00 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:01.111163 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-13218599-483b-44e2-9a56-d166116e7ccf req-6099d6dc-5dff-4294-8393-56439e6ea246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29f8f878-fe8d-4dd0-9478-268c08885faf", "tag": "693064f5-7b97-41dc-8a3f-8c6ce5d17036"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:01.116236 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-13218599-483b-44e2-9a56-d166116e7ccf req-6099d6dc-5dff-4294-8393-56439e6ea246 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:01.116571 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-13218599-483b-44e2-9a56-d166116e7ccf req-6099d6dc-5dff-4294-8393-56439e6ea246 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:01.118192 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-13218599-483b-44e2-9a56-d166116e7ccf req-6099d6dc-5dff-4294-8393-56439e6ea246 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:01.133254 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-13218599-483b-44e2-9a56-d166116e7ccf req-6099d6dc-5dff-4294-8393-56439e6ea246 service nova] Creating event network-changed:693064f5-7b97-41dc-8a3f-8c6ce5d17036 for instance 29f8f878-fe8d-4dd0-9478-268c08885faf on hv-cinder-86248 Oct 24 13:14:01.138894 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-13218599-483b-44e2-9a56-d166116e7ccf req-6099d6dc-5dff-4294-8393-56439e6ea246 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042828 Oct 24 13:14:01.139869 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 93/174] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:14:02.006761 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-0a54ffa8-9dc1-412e-a312-2ccb646aa30d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:02.007431 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-0a54ffa8-9dc1-412e-a312-2ccb646aa30d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:02.015038 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a54ffa8-9dc1-412e-a312-2ccb646aa30d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:02.015556 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a54ffa8-9dc1-412e-a312-2ccb646aa30d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:02.015992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a54ffa8-9dc1-412e-a312-2ccb646aa30d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:02.016692 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a54ffa8-9dc1-412e-a312-2ccb646aa30d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:02.017148 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a54ffa8-9dc1-412e-a312-2ccb646aa30d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:02.017573 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a54ffa8-9dc1-412e-a312-2ccb646aa30d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:02.218280 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-0a54ffa8-9dc1-412e-a312-2ccb646aa30d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:02.227645 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-0a54ffa8-9dc1-412e-a312-2ccb646aa30d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.225553 Oct 24 13:14:02.228832 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 82/175] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:02 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:03.252417 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-25fcf390-7ce4-440c-b3cf-ac4208b86e38 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:03.253035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-25fcf390-7ce4-440c-b3cf-ac4208b86e38 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:03.259178 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-25fcf390-7ce4-440c-b3cf-ac4208b86e38 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:03.259659 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-25fcf390-7ce4-440c-b3cf-ac4208b86e38 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:03.260355 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-25fcf390-7ce4-440c-b3cf-ac4208b86e38 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:03.261044 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-25fcf390-7ce4-440c-b3cf-ac4208b86e38 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:03.261495 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-25fcf390-7ce4-440c-b3cf-ac4208b86e38 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:03.261915 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-25fcf390-7ce4-440c-b3cf-ac4208b86e38 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:03.389706 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-25fcf390-7ce4-440c-b3cf-ac4208b86e38 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:03.397304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-25fcf390-7ce4-440c-b3cf-ac4208b86e38 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.149212 Oct 24 13:14:03.397862 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 94/176] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:03 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:04.421171 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-1f795ea9-2f4d-4a5c-b8cb-c2cecfdb617a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:04.421779 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-1f795ea9-2f4d-4a5c-b8cb-c2cecfdb617a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:04.424191 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:04.429398 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1f795ea9-2f4d-4a5c-b8cb-c2cecfdb617a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:04.429875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1f795ea9-2f4d-4a5c-b8cb-c2cecfdb617a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:04.430303 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1f795ea9-2f4d-4a5c-b8cb-c2cecfdb617a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:04.430984 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1f795ea9-2f4d-4a5c-b8cb-c2cecfdb617a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:04.431454 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1f795ea9-2f4d-4a5c-b8cb-c2cecfdb617a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:04.431870 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1f795ea9-2f4d-4a5c-b8cb-c2cecfdb617a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:04.571951 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-1f795ea9-2f4d-4a5c-b8cb-c2cecfdb617a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:04.580054 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-1f795ea9-2f4d-4a5c-b8cb-c2cecfdb617a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.163785 Oct 24 13:14:04.580618 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 83/177] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:04 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:05.170567 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-28056fb8-7099-4717-adef-4f20fb257c2c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1204284168", "imageRef": "4d2e5f3e-4aee-48d2-8ada-0b420d141f1b", "flavorRef": "452", "networks": [{"uuid": "d798f212-6307-408f-b9ac-6cfe966ca074"}]}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:05.224135 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.network.neutron [None req-28056fb8-7099-4717-adef-4f20fb257c2c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] validate_networks() for [('d798f212-6307-408f-b9ac-6cfe966ca074', None, None, None, None, None)] {{(pid=118914) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:14:05.577465 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-28056fb8-7099-4717-adef-4f20fb257c2c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Flavor limits 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:14:05.578024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-28056fb8-7099-4717-adef-4f20fb257c2c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Image limits 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:14:05.578906 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-28056fb8-7099-4717-adef-4f20fb257c2c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Flavor pref 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:14:05.579217 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-28056fb8-7099-4717-adef-4f20fb257c2c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Image pref 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:14:05.579857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-28056fb8-7099-4717-adef-4f20fb257c2c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:14:05.589944 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-28056fb8-7099-4717-adef-4f20fb257c2c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:05.591487 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-28056fb8-7099-4717-adef-4f20fb257c2c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:05.592329 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-28056fb8-7099-4717-adef-4f20fb257c2c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:05.593785 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-28056fb8-7099-4717-adef-4f20fb257c2c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:05.594562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-28056fb8-7099-4717-adef-4f20fb257c2c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:05.595379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-28056fb8-7099-4717-adef-4f20fb257c2c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:05.602979 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-b07d2b70-9aee-4fe3-b13c-2219eef30a14 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:05.603701 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-b07d2b70-9aee-4fe3-b13c-2219eef30a14 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:05.612551 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b07d2b70-9aee-4fe3-b13c-2219eef30a14 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:05.613277 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b07d2b70-9aee-4fe3-b13c-2219eef30a14 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:05.613762 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b07d2b70-9aee-4fe3-b13c-2219eef30a14 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:05.614593 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b07d2b70-9aee-4fe3-b13c-2219eef30a14 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:05.615075 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b07d2b70-9aee-4fe3-b13c-2219eef30a14 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:05.615539 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b07d2b70-9aee-4fe3-b13c-2219eef30a14 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:05.621289 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-28056fb8-7099-4717-adef-4f20fb257c2c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Getting quotas for project 5b028ba991e14292803f73d38f7003dc. Resources: {'cores', 'instances', 'ram'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:14:05.626448 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-28056fb8-7099-4717-adef-4f20fb257c2c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Getting quotas for user 1fd3d61c9fad4ac8ae26433ec77cd9c8 and project 5b028ba991e14292803f73d38f7003dc. Resources: {'cores', 'instances', 'ram'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:14:05.640067 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-28056fb8-7099-4717-adef-4f20fb257c2c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Going to run 1 instances... {{(pid=118914) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:14:05.642938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-28056fb8-7099-4717-adef-4f20fb257c2c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4d2e5f3e-4aee-48d2-8ada-0b420d141f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:14:05.698168 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-28056fb8-7099-4717-adef-4f20fb257c2c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532092 Oct 24 13:14:05.699529 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 95/178] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 24 13:14:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:14:05.711740 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-178bef2b-bb21-4263-a5fa-a65ab9275ab0 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:05.713463 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-178bef2b-bb21-4263-a5fa-a65ab9275ab0 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:05.782753 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-178bef2b-bb21-4263-a5fa-a65ab9275ab0 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:05.789910 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-178bef2b-bb21-4263-a5fa-a65ab9275ab0 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7" status: 200 len: 1214 microversion: 2.1 time: 0.082380 Oct 24 13:14:05.804004 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 96/179] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:05 2022] GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:05.816451 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-b07d2b70-9aee-4fe3-b13c-2219eef30a14 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:05.831464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-b07d2b70-9aee-4fe3-b13c-2219eef30a14 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.233080 Oct 24 13:14:05.843612 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 84/180] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:05 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:06.818127 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-50af3ad9-6145-4ed4-a727-6447a3d667cf tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:06.818768 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-50af3ad9-6145-4ed4-a727-6447a3d667cf tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:06.824979 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-50af3ad9-6145-4ed4-a727-6447a3d667cf tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:06.825279 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-50af3ad9-6145-4ed4-a727-6447a3d667cf tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:06.825727 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-50af3ad9-6145-4ed4-a727-6447a3d667cf tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:06.826589 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-50af3ad9-6145-4ed4-a727-6447a3d667cf tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:06.827047 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-50af3ad9-6145-4ed4-a727-6447a3d667cf tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:06.827489 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-50af3ad9-6145-4ed4-a727-6447a3d667cf tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:06.864503 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-1ae86ea1-6d19-4584-aae8-5ea5e804ca8e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:06.865741 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-1ae86ea1-6d19-4584-aae8-5ea5e804ca8e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:06.877961 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1ae86ea1-6d19-4584-aae8-5ea5e804ca8e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:06.878810 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1ae86ea1-6d19-4584-aae8-5ea5e804ca8e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:06.879729 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1ae86ea1-6d19-4584-aae8-5ea5e804ca8e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:06.880871 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1ae86ea1-6d19-4584-aae8-5ea5e804ca8e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:06.881684 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1ae86ea1-6d19-4584-aae8-5ea5e804ca8e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:06.882362 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1ae86ea1-6d19-4584-aae8-5ea5e804ca8e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:06.900086 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-50af3ad9-6145-4ed4-a727-6447a3d667cf tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:06.909557 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-50af3ad9-6145-4ed4-a727-6447a3d667cf tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7" status: 200 len: 1266 microversion: 2.1 time: 0.096145 Oct 24 13:14:06.923637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 97/181] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:06 2022] GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:07.104502 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-1ae86ea1-6d19-4584-aae8-5ea5e804ca8e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:07.114231 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-1ae86ea1-6d19-4584-aae8-5ea5e804ca8e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.261605 Oct 24 13:14:07.115256 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 85/182] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:06 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:07.934834 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-e2a9f8f1-e27a-4c2d-9821-c06a300aafee tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:07.935481 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-e2a9f8f1-e27a-4c2d-9821-c06a300aafee tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:07.941395 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e2a9f8f1-e27a-4c2d-9821-c06a300aafee tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:07.941880 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e2a9f8f1-e27a-4c2d-9821-c06a300aafee tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:07.942315 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e2a9f8f1-e27a-4c2d-9821-c06a300aafee tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:07.943000 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e2a9f8f1-e27a-4c2d-9821-c06a300aafee tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:07.943484 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e2a9f8f1-e27a-4c2d-9821-c06a300aafee tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:07.943909 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e2a9f8f1-e27a-4c2d-9821-c06a300aafee tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:08.069040 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-e2a9f8f1-e27a-4c2d-9821-c06a300aafee tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:08.077337 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-e2a9f8f1-e27a-4c2d-9821-c06a300aafee tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7" status: 200 len: 1314 microversion: 2.1 time: 0.146871 Oct 24 13:14:08.077914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 98/183] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:07 2022] GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:08.140194 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-eda29719-2e4e-480f-a791-cb2c75a37130 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:08.140806 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-eda29719-2e4e-480f-a791-cb2c75a37130 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:08.146656 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-eda29719-2e4e-480f-a791-cb2c75a37130 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:08.147165 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-eda29719-2e4e-480f-a791-cb2c75a37130 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:08.147596 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-eda29719-2e4e-480f-a791-cb2c75a37130 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:08.148278 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-eda29719-2e4e-480f-a791-cb2c75a37130 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:08.148728 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-eda29719-2e4e-480f-a791-cb2c75a37130 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:08.149147 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-eda29719-2e4e-480f-a791-cb2c75a37130 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:08.281813 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-eda29719-2e4e-480f-a791-cb2c75a37130 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:08.289495 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-eda29719-2e4e-480f-a791-cb2c75a37130 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.155413 Oct 24 13:14:08.290057 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 86/184] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:08 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:09.100380 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-59b137e9-1aa8-4e3f-ba03-bef2b1379869 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:09.101092 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-59b137e9-1aa8-4e3f-ba03-bef2b1379869 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:09.107852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-59b137e9-1aa8-4e3f-ba03-bef2b1379869 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:09.108417 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-59b137e9-1aa8-4e3f-ba03-bef2b1379869 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:09.108741 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-59b137e9-1aa8-4e3f-ba03-bef2b1379869 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:09.109421 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-59b137e9-1aa8-4e3f-ba03-bef2b1379869 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:09.109871 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-59b137e9-1aa8-4e3f-ba03-bef2b1379869 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:09.110289 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-59b137e9-1aa8-4e3f-ba03-bef2b1379869 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:09.243962 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-59b137e9-1aa8-4e3f-ba03-bef2b1379869 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:09.252884 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-59b137e9-1aa8-4e3f-ba03-bef2b1379869 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7" status: 200 len: 1314 microversion: 2.1 time: 0.156238 Oct 24 13:14:09.253594 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 99/185] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:09 2022] GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:09.313818 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-013e65cb-096e-4409-9569-89015a32fef3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:09.314427 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-013e65cb-096e-4409-9569-89015a32fef3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:09.321109 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-013e65cb-096e-4409-9569-89015a32fef3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:09.321585 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-013e65cb-096e-4409-9569-89015a32fef3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:09.322012 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-013e65cb-096e-4409-9569-89015a32fef3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:09.322732 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-013e65cb-096e-4409-9569-89015a32fef3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:09.323207 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-013e65cb-096e-4409-9569-89015a32fef3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:09.323626 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-013e65cb-096e-4409-9569-89015a32fef3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:09.532342 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-013e65cb-096e-4409-9569-89015a32fef3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:09.539948 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-013e65cb-096e-4409-9569-89015a32fef3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.230045 Oct 24 13:14:09.540512 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 87/186] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:09 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:10.276197 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-7da3053f-a89e-4c93-bfd9-7fd10430a8da tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:10.277360 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-7da3053f-a89e-4c93-bfd9-7fd10430a8da tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:10.283861 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7da3053f-a89e-4c93-bfd9-7fd10430a8da tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:10.284553 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7da3053f-a89e-4c93-bfd9-7fd10430a8da tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:10.284980 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7da3053f-a89e-4c93-bfd9-7fd10430a8da tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:10.285663 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7da3053f-a89e-4c93-bfd9-7fd10430a8da tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:10.286286 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7da3053f-a89e-4c93-bfd9-7fd10430a8da tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:10.286682 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7da3053f-a89e-4c93-bfd9-7fd10430a8da tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:10.506095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-7da3053f-a89e-4c93-bfd9-7fd10430a8da tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:10.515654 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-7da3053f-a89e-4c93-bfd9-7fd10430a8da tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7" status: 200 len: 1314 microversion: 2.1 time: 0.243179 Oct 24 13:14:10.529229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 100/187] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:10 2022] GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:10.564353 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-655c381e-da15-4825-9ef4-c0d294850683 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:10.565616 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-655c381e-da15-4825-9ef4-c0d294850683 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:10.573944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-655c381e-da15-4825-9ef4-c0d294850683 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:10.574464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-655c381e-da15-4825-9ef4-c0d294850683 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:10.575231 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-655c381e-da15-4825-9ef4-c0d294850683 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:10.576006 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-655c381e-da15-4825-9ef4-c0d294850683 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:10.576797 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-655c381e-da15-4825-9ef4-c0d294850683 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:10.577818 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-655c381e-da15-4825-9ef4-c0d294850683 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:10.739914 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-655c381e-da15-4825-9ef4-c0d294850683 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:10.748590 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-655c381e-da15-4825-9ef4-c0d294850683 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.189557 Oct 24 13:14:10.749777 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 88/188] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:10 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:11.281715 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-4a25e781-fd8f-4f38-9dae-37f19d4ab67f req-1d866e09-b917-4841-8c80-2e79c23a969d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "707b11f8-c624-4301-8f29-c0e6ede861f7", "tag": "2ad53909-5a3a-48e1-98cc-11ccca3e1bd4"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:11.306597 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-4a25e781-fd8f-4f38-9dae-37f19d4ab67f req-1d866e09-b917-4841-8c80-2e79c23a969d service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:11.307604 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-4a25e781-fd8f-4f38-9dae-37f19d4ab67f req-1d866e09-b917-4841-8c80-2e79c23a969d service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:11.308045 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-4a25e781-fd8f-4f38-9dae-37f19d4ab67f req-1d866e09-b917-4841-8c80-2e79c23a969d service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:11.328378 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-4a25e781-fd8f-4f38-9dae-37f19d4ab67f req-1d866e09-b917-4841-8c80-2e79c23a969d service nova] Creating event network-changed:2ad53909-5a3a-48e1-98cc-11ccca3e1bd4 for instance 707b11f8-c624-4301-8f29-c0e6ede861f7 on hv-cinder-86248 Oct 24 13:14:11.333582 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-4a25e781-fd8f-4f38-9dae-37f19d4ab67f req-1d866e09-b917-4841-8c80-2e79c23a969d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056530 Oct 24 13:14:11.334433 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 101/189] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:14:11.542840 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-6149c534-a987-4a19-8197-ae1bb9b1f7f2 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:11.544362 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-6149c534-a987-4a19-8197-ae1bb9b1f7f2 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:11.550664 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6149c534-a987-4a19-8197-ae1bb9b1f7f2 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:11.551563 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6149c534-a987-4a19-8197-ae1bb9b1f7f2 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:11.552158 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6149c534-a987-4a19-8197-ae1bb9b1f7f2 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:11.553047 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6149c534-a987-4a19-8197-ae1bb9b1f7f2 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:11.553732 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6149c534-a987-4a19-8197-ae1bb9b1f7f2 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:11.554154 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6149c534-a987-4a19-8197-ae1bb9b1f7f2 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:11.702068 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-6149c534-a987-4a19-8197-ae1bb9b1f7f2 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:11.711927 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-6149c534-a987-4a19-8197-ae1bb9b1f7f2 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7" status: 200 len: 1314 microversion: 2.1 time: 0.173795 Oct 24 13:14:11.712516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 89/190] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:11 2022] GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:11.777752 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-4fbfb8d4-f079-478d-a566-f66957276ac4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:11.779352 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-4fbfb8d4-f079-478d-a566-f66957276ac4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:11.787305 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4fbfb8d4-f079-478d-a566-f66957276ac4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:11.787797 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4fbfb8d4-f079-478d-a566-f66957276ac4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:11.788419 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4fbfb8d4-f079-478d-a566-f66957276ac4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:11.789822 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4fbfb8d4-f079-478d-a566-f66957276ac4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:11.790604 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4fbfb8d4-f079-478d-a566-f66957276ac4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:11.791355 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4fbfb8d4-f079-478d-a566-f66957276ac4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:11.816607 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=100 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:11.949124 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-4fbfb8d4-f079-478d-a566-f66957276ac4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:11.957509 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-4fbfb8d4-f079-478d-a566-f66957276ac4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.185276 Oct 24 13:14:11.958300 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 102/191] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:11 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:12.303970 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-a46588a1-78d5-48e3-bee6-aa87e6c57dcf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:12.304507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-a46588a1-78d5-48e3-bee6-aa87e6c57dcf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:12.310993 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a46588a1-78d5-48e3-bee6-aa87e6c57dcf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:12.311494 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a46588a1-78d5-48e3-bee6-aa87e6c57dcf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:12.311926 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a46588a1-78d5-48e3-bee6-aa87e6c57dcf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:12.315313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a46588a1-78d5-48e3-bee6-aa87e6c57dcf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:12.315313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a46588a1-78d5-48e3-bee6-aa87e6c57dcf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:12.315313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a46588a1-78d5-48e3-bee6-aa87e6c57dcf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:12.340157 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-a46588a1-78d5-48e3-bee6-aa87e6c57dcf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b/ips" status: 200 len: 150 microversion: 2.1 time: 0.040232 Oct 24 13:14:12.341506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 90/192] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Oct 24 13:14:12 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:14:12.736850 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-81c23d8e-bff5-4713-9a27-b1dc7714c859 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:12.737463 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-81c23d8e-bff5-4713-9a27-b1dc7714c859 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:12.747416 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-81c23d8e-bff5-4713-9a27-b1dc7714c859 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:12.762900 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-81c23d8e-bff5-4713-9a27-b1dc7714c859 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:12.762900 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-81c23d8e-bff5-4713-9a27-b1dc7714c859 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:12.767267 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-81c23d8e-bff5-4713-9a27-b1dc7714c859 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:12.767752 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-81c23d8e-bff5-4713-9a27-b1dc7714c859 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:12.768170 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-81c23d8e-bff5-4713-9a27-b1dc7714c859 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:12.982757 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-36aed73b-c2b8-4ab9-977a-a236dabd0c33 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:12.983415 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-36aed73b-c2b8-4ab9-977a-a236dabd0c33 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:12.989946 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-36aed73b-c2b8-4ab9-977a-a236dabd0c33 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:12.990423 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-36aed73b-c2b8-4ab9-977a-a236dabd0c33 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:12.990851 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-36aed73b-c2b8-4ab9-977a-a236dabd0c33 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:12.991568 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-36aed73b-c2b8-4ab9-977a-a236dabd0c33 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:12.992217 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-36aed73b-c2b8-4ab9-977a-a236dabd0c33 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:12.992638 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-36aed73b-c2b8-4ab9-977a-a236dabd0c33 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:13.037865 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-81c23d8e-bff5-4713-9a27-b1dc7714c859 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:13.047900 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-81c23d8e-bff5-4713-9a27-b1dc7714c859 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7" status: 200 len: 1314 microversion: 2.1 time: 0.314911 Oct 24 13:14:13.048848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 103/193] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:12 2022] GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:13.171202 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-36aed73b-c2b8-4ab9-977a-a236dabd0c33 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:13.179185 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-36aed73b-c2b8-4ab9-977a-a236dabd0c33 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.201302 Oct 24 13:14:13.180008 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 91/194] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:12 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:13.828552 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a54051d0-40f1-4a2e-95b7-2886b3a97505 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99be6ba9-f51a-40ba-8065-d711f27d5f99"}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:13.831686 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a54051d0-40f1-4a2e-95b7-2886b3a97505 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:13.838604 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a54051d0-40f1-4a2e-95b7-2886b3a97505 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:13.839117 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a54051d0-40f1-4a2e-95b7-2886b3a97505 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:13.839563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a54051d0-40f1-4a2e-95b7-2886b3a97505 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:13.840987 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a54051d0-40f1-4a2e-95b7-2886b3a97505 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:13.841718 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a54051d0-40f1-4a2e-95b7-2886b3a97505 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:13.842155 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a54051d0-40f1-4a2e-95b7-2886b3a97505 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:14.085379 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-5663c6c8-d1ce-41f5-9389-60d60e38b790 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:14.087001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-5663c6c8-d1ce-41f5-9389-60d60e38b790 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:14.095751 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5663c6c8-d1ce-41f5-9389-60d60e38b790 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:14.096284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5663c6c8-d1ce-41f5-9389-60d60e38b790 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:14.097101 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5663c6c8-d1ce-41f5-9389-60d60e38b790 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:14.097823 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5663c6c8-d1ce-41f5-9389-60d60e38b790 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:14.098734 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5663c6c8-d1ce-41f5-9389-60d60e38b790 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:14.099445 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5663c6c8-d1ce-41f5-9389-60d60e38b790 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:14.150175 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a54051d0-40f1-4a2e-95b7-2886b3a97505 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "POST /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326944 Oct 24 13:14:14.150814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 104/195] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 24 13:14:13 2022] POST /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b/os-volume_attachments => generated 194 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:14:14.202696 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-9d16b148-ba8f-49e6-9de6-6e812a00f234 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:14.203707 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-9d16b148-ba8f-49e6-9de6-6e812a00f234 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:14.217811 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9d16b148-ba8f-49e6-9de6-6e812a00f234 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:14.218478 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9d16b148-ba8f-49e6-9de6-6e812a00f234 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:14.219816 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9d16b148-ba8f-49e6-9de6-6e812a00f234 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:14.230752 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9d16b148-ba8f-49e6-9de6-6e812a00f234 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:14.230752 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9d16b148-ba8f-49e6-9de6-6e812a00f234 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:14.230752 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9d16b148-ba8f-49e6-9de6-6e812a00f234 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:14.337341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-5663c6c8-d1ce-41f5-9389-60d60e38b790 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:14.347253 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-5663c6c8-d1ce-41f5-9389-60d60e38b790 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7" status: 200 len: 1314 microversion: 2.1 time: 0.272491 Oct 24 13:14:14.364339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 92/196] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:14 2022] GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:14.408460 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-9d16b148-ba8f-49e6-9de6-6e812a00f234 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:14.416310 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-9d16b148-ba8f-49e6-9de6-6e812a00f234 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.218240 Oct 24 13:14:14.416872 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 105/197] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:14 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:15.373126 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-ea1294b8-1b1e-4cd5-a757-58112317179e tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:15.373883 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-ea1294b8-1b1e-4cd5-a757-58112317179e tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:15.380756 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ea1294b8-1b1e-4cd5-a757-58112317179e tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:15.381281 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ea1294b8-1b1e-4cd5-a757-58112317179e tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:15.381741 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ea1294b8-1b1e-4cd5-a757-58112317179e tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:15.382484 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ea1294b8-1b1e-4cd5-a757-58112317179e tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:15.382922 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ea1294b8-1b1e-4cd5-a757-58112317179e tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:15.383380 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ea1294b8-1b1e-4cd5-a757-58112317179e tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:15.441263 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-73f178d0-f37e-4f9b-9e72-019959d661b6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:15.441836 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-73f178d0-f37e-4f9b-9e72-019959d661b6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:15.450605 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-73f178d0-f37e-4f9b-9e72-019959d661b6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:15.452077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-73f178d0-f37e-4f9b-9e72-019959d661b6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:15.452077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-73f178d0-f37e-4f9b-9e72-019959d661b6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:15.452476 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-73f178d0-f37e-4f9b-9e72-019959d661b6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:15.453005 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-73f178d0-f37e-4f9b-9e72-019959d661b6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:15.453374 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-73f178d0-f37e-4f9b-9e72-019959d661b6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:15.526523 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-ea1294b8-1b1e-4cd5-a757-58112317179e tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:15.536051 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-ea1294b8-1b1e-4cd5-a757-58112317179e tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7" status: 200 len: 1314 microversion: 2.1 time: 0.166772 Oct 24 13:14:15.536639 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 93/198] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:15 2022] GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:15.605120 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-73f178d0-f37e-4f9b-9e72-019959d661b6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:15.607850 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=2 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:15.614712 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-73f178d0-f37e-4f9b-9e72-019959d661b6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.177657 Oct 24 13:14:15.615369 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 106/199] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:15 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:16.564041 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-da71d847-a4af-4d97-adef-203be2e0e294 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:16.564651 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-da71d847-a4af-4d97-adef-203be2e0e294 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:16.571255 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-da71d847-a4af-4d97-adef-203be2e0e294 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:16.571733 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-da71d847-a4af-4d97-adef-203be2e0e294 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:16.572163 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-da71d847-a4af-4d97-adef-203be2e0e294 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:16.572843 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-da71d847-a4af-4d97-adef-203be2e0e294 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:16.573292 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-da71d847-a4af-4d97-adef-203be2e0e294 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:16.573713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-da71d847-a4af-4d97-adef-203be2e0e294 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:16.639994 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-39756d60-89ac-4212-941a-227a5650a7b4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:16.640755 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-39756d60-89ac-4212-941a-227a5650a7b4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:16.642799 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=8 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:16.649257 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-39756d60-89ac-4212-941a-227a5650a7b4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:16.649731 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-39756d60-89ac-4212-941a-227a5650a7b4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:16.650157 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-39756d60-89ac-4212-941a-227a5650a7b4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:16.651162 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-39756d60-89ac-4212-941a-227a5650a7b4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:16.651335 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-39756d60-89ac-4212-941a-227a5650a7b4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:16.651750 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-39756d60-89ac-4212-941a-227a5650a7b4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:16.713232 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-da71d847-a4af-4d97-adef-203be2e0e294 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:16.720996 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-da71d847-a4af-4d97-adef-203be2e0e294 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7" status: 200 len: 1314 microversion: 2.1 time: 0.161660 Oct 24 13:14:16.721570 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 94/200] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:16 2022] GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:16.785338 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-39756d60-89ac-4212-941a-227a5650a7b4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:16.792962 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-39756d60-89ac-4212-941a-227a5650a7b4 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.157835 Oct 24 13:14:16.794267 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 107/201] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:16 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:17.743778 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9bd68147-3b58-483e-a5fa-15348f597007 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:17.744393 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9bd68147-3b58-483e-a5fa-15348f597007 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:17.751461 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9bd68147-3b58-483e-a5fa-15348f597007 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:17.751944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9bd68147-3b58-483e-a5fa-15348f597007 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:17.752383 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9bd68147-3b58-483e-a5fa-15348f597007 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:17.753070 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9bd68147-3b58-483e-a5fa-15348f597007 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:17.753520 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9bd68147-3b58-483e-a5fa-15348f597007 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:17.753943 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9bd68147-3b58-483e-a5fa-15348f597007 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:17.757995 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:17.816554 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-88d69056-8cd6-4a07-ae56-5bd37a3b9049 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:17.817171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-88d69056-8cd6-4a07-ae56-5bd37a3b9049 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:17.823509 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-88d69056-8cd6-4a07-ae56-5bd37a3b9049 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:17.831424 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-88d69056-8cd6-4a07-ae56-5bd37a3b9049 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:17.831936 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-88d69056-8cd6-4a07-ae56-5bd37a3b9049 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:17.832694 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-88d69056-8cd6-4a07-ae56-5bd37a3b9049 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:17.833190 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-88d69056-8cd6-4a07-ae56-5bd37a3b9049 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:17.833624 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-88d69056-8cd6-4a07-ae56-5bd37a3b9049 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:17.924935 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-9bd68147-3b58-483e-a5fa-15348f597007 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:17.934652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-9bd68147-3b58-483e-a5fa-15348f597007 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7" status: 200 len: 1314 microversion: 2.1 time: 0.194072 Oct 24 13:14:17.935354 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 95/202] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:17 2022] GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:18.021183 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-88d69056-8cd6-4a07-ae56-5bd37a3b9049 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:18.030318 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-88d69056-8cd6-4a07-ae56-5bd37a3b9049 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.217459 Oct 24 13:14:18.030914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 108/203] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:17 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:18.586399 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-2c3a3f90-2f14-460c-90ca-c0865d811a22 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:18.586811 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-2c3a3f90-2f14-460c-90ca-c0865d811a22 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:18.594428 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c3a3f90-2f14-460c-90ca-c0865d811a22 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:18.594898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c3a3f90-2f14-460c-90ca-c0865d811a22 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:18.595350 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c3a3f90-2f14-460c-90ca-c0865d811a22 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:18.596026 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c3a3f90-2f14-460c-90ca-c0865d811a22 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:18.596471 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c3a3f90-2f14-460c-90ca-c0865d811a22 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:18.596884 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c3a3f90-2f14-460c-90ca-c0865d811a22 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:18.620192 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-2c3a3f90-2f14-460c-90ca-c0865d811a22 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/ips" status: 200 len: 152 microversion: 2.20 time: 0.037750 Oct 24 13:14:18.620740 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 96/204] 10.222.0.42 () {60 vars in 1289 bytes} [Mon Oct 24 13:14:18 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:14:18.957999 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-01b6b3e1-66ed-4aaa-824a-b7be4da5c597 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:18.958666 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-01b6b3e1-66ed-4aaa-824a-b7be4da5c597 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:18.970689 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-01b6b3e1-66ed-4aaa-824a-b7be4da5c597 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:18.971210 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-01b6b3e1-66ed-4aaa-824a-b7be4da5c597 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:18.971700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-01b6b3e1-66ed-4aaa-824a-b7be4da5c597 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:18.972472 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-01b6b3e1-66ed-4aaa-824a-b7be4da5c597 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:18.972929 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-01b6b3e1-66ed-4aaa-824a-b7be4da5c597 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:18.973500 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-01b6b3e1-66ed-4aaa-824a-b7be4da5c597 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:19.055121 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-396c9b54-5118-4c01-a6c8-74c7d0061618 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:19.056335 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-396c9b54-5118-4c01-a6c8-74c7d0061618 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:19.063364 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-396c9b54-5118-4c01-a6c8-74c7d0061618 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:19.064093 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-396c9b54-5118-4c01-a6c8-74c7d0061618 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:19.064533 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-396c9b54-5118-4c01-a6c8-74c7d0061618 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:19.065232 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-396c9b54-5118-4c01-a6c8-74c7d0061618 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:19.065688 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-396c9b54-5118-4c01-a6c8-74c7d0061618 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:19.071249 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-396c9b54-5118-4c01-a6c8-74c7d0061618 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:19.119646 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-01b6b3e1-66ed-4aaa-824a-b7be4da5c597 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:19.128427 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-01b6b3e1-66ed-4aaa-824a-b7be4da5c597 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7" status: 200 len: 1314 microversion: 2.1 time: 0.174575 Oct 24 13:14:19.128999 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 109/205] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:18 2022] GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:19.218446 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-396c9b54-5118-4c01-a6c8-74c7d0061618 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:19.226420 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-396c9b54-5118-4c01-a6c8-74c7d0061618 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.175302 Oct 24 13:14:19.227107 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 97/206] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:19 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:19.813461 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-2b243b4d-4056-4716-81c6-edf411c79493 req-b85b54b7-9be8-4077-8321-be70ee782bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707b11f8-c624-4301-8f29-c0e6ede861f7", "name": "network-vif-plugged", "status": "completed", "tag": "2ad53909-5a3a-48e1-98cc-11ccca3e1bd4"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:19.826311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-2b243b4d-4056-4716-81c6-edf411c79493 req-b85b54b7-9be8-4077-8321-be70ee782bb3 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:19.826922 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-2b243b4d-4056-4716-81c6-edf411c79493 req-b85b54b7-9be8-4077-8321-be70ee782bb3 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:19.827389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-2b243b4d-4056-4716-81c6-edf411c79493 req-b85b54b7-9be8-4077-8321-be70ee782bb3 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:19.839794 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-2b243b4d-4056-4716-81c6-edf411c79493 req-b85b54b7-9be8-4077-8321-be70ee782bb3 service nova] Creating event network-vif-plugged:2ad53909-5a3a-48e1-98cc-11ccca3e1bd4 for instance 707b11f8-c624-4301-8f29-c0e6ede861f7 on hv-cinder-86248 Oct 24 13:14:19.845144 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-2b243b4d-4056-4716-81c6-edf411c79493 req-b85b54b7-9be8-4077-8321-be70ee782bb3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036372 Oct 24 13:14:19.846212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 110/207] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:14:20.152192 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-0a6d2459-b9b6-4bef-97a2-c773427020e5 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:20.153471 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-0a6d2459-b9b6-4bef-97a2-c773427020e5 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:20.160022 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a6d2459-b9b6-4bef-97a2-c773427020e5 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:20.160510 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a6d2459-b9b6-4bef-97a2-c773427020e5 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:20.160945 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a6d2459-b9b6-4bef-97a2-c773427020e5 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:20.161643 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a6d2459-b9b6-4bef-97a2-c773427020e5 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:20.162098 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a6d2459-b9b6-4bef-97a2-c773427020e5 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:20.162521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a6d2459-b9b6-4bef-97a2-c773427020e5 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:20.252206 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-b999411d-ada3-4e54-a41a-e01f0000f663 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:20.252206 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-b999411d-ada3-4e54-a41a-e01f0000f663 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:20.257636 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b999411d-ada3-4e54-a41a-e01f0000f663 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:20.258126 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b999411d-ada3-4e54-a41a-e01f0000f663 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:20.258614 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b999411d-ada3-4e54-a41a-e01f0000f663 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:20.259271 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b999411d-ada3-4e54-a41a-e01f0000f663 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:20.259731 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b999411d-ada3-4e54-a41a-e01f0000f663 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:20.260419 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b999411d-ada3-4e54-a41a-e01f0000f663 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:20.309880 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-0a6d2459-b9b6-4bef-97a2-c773427020e5 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:20.320695 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-0a6d2459-b9b6-4bef-97a2-c773427020e5 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7" status: 200 len: 1314 microversion: 2.1 time: 0.172317 Oct 24 13:14:20.321273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 98/208] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:20 2022] GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:20.406221 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-b999411d-ada3-4e54-a41a-e01f0000f663 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:20.413906 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-b999411d-ada3-4e54-a41a-e01f0000f663 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.167956 Oct 24 13:14:20.414473 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 111/209] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:20 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:21.163273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-21879835-4a9a-49ff-ad95-cba72b636ce6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:21.163273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-21879835-4a9a-49ff-ad95-cba72b636ce6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:21.166426 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-21879835-4a9a-49ff-ad95-cba72b636ce6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:21.166974 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-21879835-4a9a-49ff-ad95-cba72b636ce6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:21.167502 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-21879835-4a9a-49ff-ad95-cba72b636ce6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:21.168881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-21879835-4a9a-49ff-ad95-cba72b636ce6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:21.169339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-21879835-4a9a-49ff-ad95-cba72b636ce6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:21.169869 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-21879835-4a9a-49ff-ad95-cba72b636ce6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:21.193312 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.objects.instance [None req-21879835-4a9a-49ff-ad95-cba72b636ce6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lazy-loading 'flavor' on Instance uuid 27b5963f-5199-4822-a8c3-20a8ab09224f {{(pid=118915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:14:21.346628 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-fc3153e5-1650-45c5-8da2-e4277f02b4d0 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:21.347754 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-fc3153e5-1650-45c5-8da2-e4277f02b4d0 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:21.358549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fc3153e5-1650-45c5-8da2-e4277f02b4d0 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:21.359875 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fc3153e5-1650-45c5-8da2-e4277f02b4d0 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:21.361051 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fc3153e5-1650-45c5-8da2-e4277f02b4d0 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:21.362384 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fc3153e5-1650-45c5-8da2-e4277f02b4d0 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:21.363480 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fc3153e5-1650-45c5-8da2-e4277f02b4d0 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:21.365039 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fc3153e5-1650-45c5-8da2-e4277f02b4d0 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:21.421096 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-21879835-4a9a-49ff-ad95-cba72b636ce6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "POST /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/action" status: 202 len: 0 microversion: 2.20 time: 0.265517 Oct 24 13:14:21.425434 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 99/210] 10.222.0.42 () {62 vars in 1319 bytes} [Mon Oct 24 13:14:21 2022] POST /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 24 13:14:21.432754 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-91a3de9f-1499-4782-a7c2-a1a592be6e64 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:21.433469 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-91a3de9f-1499-4782-a7c2-a1a592be6e64 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:21.440954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-91a3de9f-1499-4782-a7c2-a1a592be6e64 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:21.441726 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-91a3de9f-1499-4782-a7c2-a1a592be6e64 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:21.442397 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-91a3de9f-1499-4782-a7c2-a1a592be6e64 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:21.443339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-91a3de9f-1499-4782-a7c2-a1a592be6e64 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:21.443797 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-91a3de9f-1499-4782-a7c2-a1a592be6e64 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:21.444222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-91a3de9f-1499-4782-a7c2-a1a592be6e64 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:21.593658 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-91a3de9f-1499-4782-a7c2-a1a592be6e64 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:21.601829 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-91a3de9f-1499-4782-a7c2-a1a592be6e64 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:21.603303 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-91a3de9f-1499-4782-a7c2-a1a592be6e64 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:21.604476 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-91a3de9f-1499-4782-a7c2-a1a592be6e64 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1721 microversion: 2.20 time: 0.177783 Oct 24 13:14:21.605036 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 100/211] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:21 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:14:21.610270 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-00184490-75e9-463a-bd45-71d4b346a8ad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:21.610882 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-00184490-75e9-463a-bd45-71d4b346a8ad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:21.617129 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-00184490-75e9-463a-bd45-71d4b346a8ad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:21.617923 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-00184490-75e9-463a-bd45-71d4b346a8ad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:21.618386 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-fc3153e5-1650-45c5-8da2-e4277f02b4d0 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:21.618732 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-00184490-75e9-463a-bd45-71d4b346a8ad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:21.619616 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-00184490-75e9-463a-bd45-71d4b346a8ad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:21.620221 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-00184490-75e9-463a-bd45-71d4b346a8ad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:21.620800 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-00184490-75e9-463a-bd45-71d4b346a8ad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:21.629759 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-fc3153e5-1650-45c5-8da2-e4277f02b4d0 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7" status: 200 len: 1314 microversion: 2.1 time: 0.288240 Oct 24 13:14:21.630514 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 112/212] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:21 2022] GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:21.757899 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-00184490-75e9-463a-bd45-71d4b346a8ad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:21.766800 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-00184490-75e9-463a-bd45-71d4b346a8ad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1502 microversion: 2.1 time: 0.160762 Oct 24 13:14:21.767440 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 101/213] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:21 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:21.791264 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-23134734-b8d5-4c90-9060-cc7c592391ee tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b39c7fd-28e7-43a6-94bd-d01a7d916ff9"}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:21.794308 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-23134734-b8d5-4c90-9060-cc7c592391ee tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:21.801907 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-23134734-b8d5-4c90-9060-cc7c592391ee tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:21.802391 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-23134734-b8d5-4c90-9060-cc7c592391ee tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:21.802833 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-23134734-b8d5-4c90-9060-cc7c592391ee tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:21.803554 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-23134734-b8d5-4c90-9060-cc7c592391ee tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:21.804034 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-23134734-b8d5-4c90-9060-cc7c592391ee tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:21.804510 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-23134734-b8d5-4c90-9060-cc7c592391ee tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:21.832093 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-23134734-b8d5-4c90-9060-cc7c592391ee tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] HTTP exception thrown: Cannot 'attach_volume' instance 2011f5ea-73ab-457d-be16-25ad031e5e96 while it is in vm_state rescued Oct 24 13:14:21.833784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-23134734-b8d5-4c90-9060-cc7c592391ee tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Request method failure captured: Oct 24 13:14:21.833784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: POST /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96/os-volume_attachments HTTP/1.1 Oct 24 13:14:21.833784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:14:21.833784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:14:21.833784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:14:21.833784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 74 Oct 24 13:14:21.833784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:14:21.833784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:14:21.833784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:14:21.833784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:14:21.833784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVo8-MVUZt3eqKP9axHhN9-YGEl3TZduwFjpEinzp6vl_5EPjxspkm0YjnuEeX52n_zMOBC2DHbIvahT4eFkJ4bpeh_VkPLMHqyH0kf3GvMdexv9ZvJHWuw2mGfp1Tv9L3Xia6cV13F533nQVQsLnKzwUhe5Mqd9rFhScRAi468eY_Qw Oct 24 13:14:21.833784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:14:21.833784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:14:21.833784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:14:21.833784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:14:21.833784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:14:21.833784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:14:21.833784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: 85d62dec32104e7b8c595953a479026b Oct 24 13:14:21.833784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2008376724 Oct 24 13:14:21.833784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:14:21.833784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:14:21.835094 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/85d62dec32104e7b8c595953a479026b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/85d62dec32104e7b8c595953a479026b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/85d62dec32104e7b8c595953a479026b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_85d62dec32104e7b8c595953a479026b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:14:21.835094 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2008376724 Oct 24 13:14:21.835094 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: 85d62dec32104e7b8c595953a479026b Oct 24 13:14:21.835094 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2008376724 Oct 24 13:14:21.835094 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-ServerRescueNegativeTestJSON-2008376724-project Oct 24 13:14:21.835094 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:14:21.835094 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:14:21.835094 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: d29ff25b062346f6bcf9910b1fa8db5c Oct 24 13:14:21.835094 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2008376724-project Oct 24 13:14:21.835094 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Oct 24 13:14:21.835094 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {"volumeAttachment": {"volumeId": "0b39c7fd-28e7-43a6-94bd-d01a7d916ff9"}} Oct 24 13:14:21.835094 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:14:21.835885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Cannot 'attach_volume' instance 2011f5ea-73ab-457d-be16-25ad031e5e96 while it is in vm_state rescued Oct 24 13:14:21.835885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'server_id': '2011f5ea-73ab-457d-be16-25ad031e5e96', 'body': {'volumeAttachment': {'volumeId': '0b39c7fd-28e7-43a6-94bd-d01a7d916ff9'}}} Oct 24 13:14:21.835885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:14:21.835885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:14:21.835885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 24 13:14:21.835885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 24 13:14:21.835885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 13:14:21.835885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 13:14:21.835885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 13:14:21.835885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 13:14:21.835885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2011f5ea-73ab-457d-be16-25ad031e5e96 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 24 13:14:21.835885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:14:21.835885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:14:21.835885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:14:21.835885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:14:21.835885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:14:21.835885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:14:21.835885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:14:21.835885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:14:21.836954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:14:21.836954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:14:21.836954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:14:21.836954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:14:21.836954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:14:21.836954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:14:21.836954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:14:21.836954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:14:21.836954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 24 13:14:21.836954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 13:14:21.836954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 13:14:21.836954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 13:14:21.836954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2011f5ea-73ab-457d-be16-25ad031e5e96 while it is in vm_state rescued Oct 24 13:14:21.836954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:14:21.836954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:14:21.836954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:14:21.836954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:14:21.836954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:14:21.836954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:14:21.838158 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:14:21.838158 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:14:21.838158 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2011f5ea-73ab-457d-be16-25ad031e5e96 while it is in vm_state rescued Oct 24 13:14:21.838158 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:14:21.838158 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-23134734-b8d5-4c90-9060-cc7c592391ee tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Returning 409 to user: Cannot 'attach_volume' instance 2011f5ea-73ab-457d-be16-25ad031e5e96 while it is in vm_state rescued {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:14:21.838158 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-23134734-b8d5-4c90-9060-cc7c592391ee tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "POST /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048648 Oct 24 13:14:21.838158 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 113/214] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 24 13:14:21 2022] POST /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 13:14:21.845687 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-eab6205a-91d4-4fce-92cb-13a4bb2629c2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:21.846365 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-eab6205a-91d4-4fce-92cb-13a4bb2629c2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:21.852590 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-eab6205a-91d4-4fce-92cb-13a4bb2629c2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:21.853154 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-eab6205a-91d4-4fce-92cb-13a4bb2629c2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:21.853668 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-eab6205a-91d4-4fce-92cb-13a4bb2629c2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:21.854536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-eab6205a-91d4-4fce-92cb-13a4bb2629c2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:21.855014 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-eab6205a-91d4-4fce-92cb-13a4bb2629c2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:21.855478 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-eab6205a-91d4-4fce-92cb-13a4bb2629c2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:21.928947 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-eab6205a-91d4-4fce-92cb-13a4bb2629c2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "POST /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96/action" status: 202 len: 0 microversion: 2.1 time: 0.088184 Oct 24 13:14:21.929710 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 102/215] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 24 13:14:21 2022] POST /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 13:14:21.938732 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-f3d87b84-73bb-4d3f-ac37-0b8e60f90453 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:21.939394 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-f3d87b84-73bb-4d3f-ac37-0b8e60f90453 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:21.945321 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f3d87b84-73bb-4d3f-ac37-0b8e60f90453 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:21.945811 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f3d87b84-73bb-4d3f-ac37-0b8e60f90453 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:21.946336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f3d87b84-73bb-4d3f-ac37-0b8e60f90453 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:21.947030 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f3d87b84-73bb-4d3f-ac37-0b8e60f90453 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:21.947514 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f3d87b84-73bb-4d3f-ac37-0b8e60f90453 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:21.947936 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f3d87b84-73bb-4d3f-ac37-0b8e60f90453 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:22.124929 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-f3d87b84-73bb-4d3f-ac37-0b8e60f90453 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:22.133017 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-f3d87b84-73bb-4d3f-ac37-0b8e60f90453 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1510 microversion: 2.1 time: 0.198122 Oct 24 13:14:22.133592 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 114/216] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:21 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1510 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:22.632920 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-31b62c06-9cc1-4f4a-8b1e-379f9e36bddc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:22.634448 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-31b62c06-9cc1-4f4a-8b1e-379f9e36bddc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:22.643810 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-31b62c06-9cc1-4f4a-8b1e-379f9e36bddc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:22.653884 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-4f1b2268-70a3-4581-94d9-3dfcf6cd45c9 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:22.654505 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-4f1b2268-70a3-4581-94d9-3dfcf6cd45c9 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:22.658299 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-31b62c06-9cc1-4f4a-8b1e-379f9e36bddc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:22.661058 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-31b62c06-9cc1-4f4a-8b1e-379f9e36bddc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:22.661863 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-31b62c06-9cc1-4f4a-8b1e-379f9e36bddc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:22.662085 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4f1b2268-70a3-4581-94d9-3dfcf6cd45c9 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:22.662350 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-31b62c06-9cc1-4f4a-8b1e-379f9e36bddc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:22.662575 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4f1b2268-70a3-4581-94d9-3dfcf6cd45c9 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:22.662783 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-31b62c06-9cc1-4f4a-8b1e-379f9e36bddc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:22.663005 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4f1b2268-70a3-4581-94d9-3dfcf6cd45c9 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:22.663726 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4f1b2268-70a3-4581-94d9-3dfcf6cd45c9 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:22.664343 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4f1b2268-70a3-4581-94d9-3dfcf6cd45c9 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:22.664777 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4f1b2268-70a3-4581-94d9-3dfcf6cd45c9 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:22.830173 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-31b62c06-9cc1-4f4a-8b1e-379f9e36bddc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:22.841280 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-31b62c06-9cc1-4f4a-8b1e-379f9e36bddc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:22.843017 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-31b62c06-9cc1-4f4a-8b1e-379f9e36bddc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:22.844167 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-31b62c06-9cc1-4f4a-8b1e-379f9e36bddc tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1721 microversion: 2.20 time: 0.216257 Oct 24 13:14:22.855494 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 103/217] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:22 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:14:22.967557 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-4f1b2268-70a3-4581-94d9-3dfcf6cd45c9 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:22.975531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-4f1b2268-70a3-4581-94d9-3dfcf6cd45c9 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7" status: 200 len: 1498 microversion: 2.1 time: 0.326578 Oct 24 13:14:22.976120 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 115/218] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:22 2022] GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 => generated 1498 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:23.158227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-713091e9-ff83-48d6-8a0c-d965ac4e7363 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:23.158948 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-713091e9-ff83-48d6-8a0c-d965ac4e7363 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:23.166346 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-713091e9-ff83-48d6-8a0c-d965ac4e7363 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:23.166832 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-713091e9-ff83-48d6-8a0c-d965ac4e7363 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:23.167280 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-713091e9-ff83-48d6-8a0c-d965ac4e7363 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:23.168734 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-713091e9-ff83-48d6-8a0c-d965ac4e7363 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:23.169247 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-713091e9-ff83-48d6-8a0c-d965ac4e7363 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:23.169748 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-713091e9-ff83-48d6-8a0c-d965ac4e7363 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:23.357833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-713091e9-ff83-48d6-8a0c-d965ac4e7363 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:23.387790 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-713091e9-ff83-48d6-8a0c-d965ac4e7363 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1510 microversion: 2.1 time: 0.232608 Oct 24 13:14:23.403621 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 104/219] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:23 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1510 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:23.472818 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-bc1679bb-8634-47f5-b214-59ef5856040a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:23.473267 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-bc1679bb-8634-47f5-b214-59ef5856040a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:23.479376 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bc1679bb-8634-47f5-b214-59ef5856040a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:23.479855 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bc1679bb-8634-47f5-b214-59ef5856040a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:23.480286 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bc1679bb-8634-47f5-b214-59ef5856040a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:23.481621 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bc1679bb-8634-47f5-b214-59ef5856040a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:23.482090 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bc1679bb-8634-47f5-b214-59ef5856040a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:23.482514 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bc1679bb-8634-47f5-b214-59ef5856040a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:23.508381 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-bc1679bb-8634-47f5-b214-59ef5856040a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Going to try to terminate instance {{(pid=118914) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:14:23.590201 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-bc1679bb-8634-47f5-b214-59ef5856040a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "DELETE /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7" status: 204 len: 0 microversion: 2.1 time: 0.121075 Oct 24 13:14:23.590794 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 116/220] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:14:23 2022] DELETE /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:14:23.599031 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-bcad19c5-6328-44db-af09-20d58d01a8d6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:23.599770 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-bcad19c5-6328-44db-af09-20d58d01a8d6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:23.605502 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bcad19c5-6328-44db-af09-20d58d01a8d6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:23.606168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bcad19c5-6328-44db-af09-20d58d01a8d6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:23.606601 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bcad19c5-6328-44db-af09-20d58d01a8d6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:23.607319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bcad19c5-6328-44db-af09-20d58d01a8d6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:23.607771 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bcad19c5-6328-44db-af09-20d58d01a8d6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:23.608198 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bcad19c5-6328-44db-af09-20d58d01a8d6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:23.742766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-bcad19c5-6328-44db-af09-20d58d01a8d6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:23.751552 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-bcad19c5-6328-44db-af09-20d58d01a8d6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7" status: 200 len: 1504 microversion: 2.1 time: 0.156237 Oct 24 13:14:23.752336 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 105/221] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:23 2022] GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:23.872657 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-1e594c45-8a1d-40e4-ae00-ac441eb9f656 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:23.873113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-1e594c45-8a1d-40e4-ae00-ac441eb9f656 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:23.879634 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1e594c45-8a1d-40e4-ae00-ac441eb9f656 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:23.880123 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1e594c45-8a1d-40e4-ae00-ac441eb9f656 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:23.880658 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1e594c45-8a1d-40e4-ae00-ac441eb9f656 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:23.881832 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1e594c45-8a1d-40e4-ae00-ac441eb9f656 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:23.882597 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1e594c45-8a1d-40e4-ae00-ac441eb9f656 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:23.883195 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1e594c45-8a1d-40e4-ae00-ac441eb9f656 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:23.889440 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:24.052564 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-1e594c45-8a1d-40e4-ae00-ac441eb9f656 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:24.063239 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-1e594c45-8a1d-40e4-ae00-ac441eb9f656 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:24.065177 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-1e594c45-8a1d-40e4-ae00-ac441eb9f656 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:24.068739 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-1e594c45-8a1d-40e4-ae00-ac441eb9f656 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1721 microversion: 2.20 time: 0.199920 Oct 24 13:14:24.069486 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 117/222] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:23 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:14:24.421713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-f52e1536-84e5-49f0-b98e-1a798c920ecc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:24.422383 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-f52e1536-84e5-49f0-b98e-1a798c920ecc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:24.432658 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f52e1536-84e5-49f0-b98e-1a798c920ecc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:24.433130 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f52e1536-84e5-49f0-b98e-1a798c920ecc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:24.433567 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f52e1536-84e5-49f0-b98e-1a798c920ecc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:24.434402 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f52e1536-84e5-49f0-b98e-1a798c920ecc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:24.434861 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f52e1536-84e5-49f0-b98e-1a798c920ecc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:24.435325 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f52e1536-84e5-49f0-b98e-1a798c920ecc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:24.593488 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-f52e1536-84e5-49f0-b98e-1a798c920ecc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:24.601907 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-f52e1536-84e5-49f0-b98e-1a798c920ecc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1510 microversion: 2.1 time: 0.187510 Oct 24 13:14:24.602785 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 106/223] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:24 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1510 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:24.779486 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-4a4528b8-2b4b-4261-af0f-463e02bca05d tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:24.780840 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-4a4528b8-2b4b-4261-af0f-463e02bca05d tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:24.787719 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4a4528b8-2b4b-4261-af0f-463e02bca05d tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:24.788779 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4a4528b8-2b4b-4261-af0f-463e02bca05d tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:24.789450 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4a4528b8-2b4b-4261-af0f-463e02bca05d tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:24.790872 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4a4528b8-2b4b-4261-af0f-463e02bca05d tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:24.791547 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4a4528b8-2b4b-4261-af0f-463e02bca05d tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:24.792174 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4a4528b8-2b4b-4261-af0f-463e02bca05d tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:24.975620 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-4a4528b8-2b4b-4261-af0f-463e02bca05d tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:24.984120 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-4a4528b8-2b4b-4261-af0f-463e02bca05d tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7" status: 200 len: 1504 microversion: 2.1 time: 0.209467 Oct 24 13:14:24.985364 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 118/224] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:24 2022] GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 => generated 1504 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:25.110194 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-79982037-3c41-4590-9210-b2f6cfb227c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:25.111018 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-79982037-3c41-4590-9210-b2f6cfb227c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:25.124546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79982037-3c41-4590-9210-b2f6cfb227c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:25.125733 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79982037-3c41-4590-9210-b2f6cfb227c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:25.126364 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79982037-3c41-4590-9210-b2f6cfb227c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:25.127143 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79982037-3c41-4590-9210-b2f6cfb227c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:25.127817 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79982037-3c41-4590-9210-b2f6cfb227c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:25.128007 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79982037-3c41-4590-9210-b2f6cfb227c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:25.282145 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-79982037-3c41-4590-9210-b2f6cfb227c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:25.290858 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-79982037-3c41-4590-9210-b2f6cfb227c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:25.292403 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-79982037-3c41-4590-9210-b2f6cfb227c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:25.294573 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-79982037-3c41-4590-9210-b2f6cfb227c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1721 microversion: 2.20 time: 0.204710 Oct 24 13:14:25.295306 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 107/225] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:25 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:14:25.626356 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-9698d2a0-f110-467e-9b7c-ce24311afac2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:25.627398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-9698d2a0-f110-467e-9b7c-ce24311afac2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:25.633766 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9698d2a0-f110-467e-9b7c-ce24311afac2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:25.634246 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9698d2a0-f110-467e-9b7c-ce24311afac2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:25.634711 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9698d2a0-f110-467e-9b7c-ce24311afac2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:25.635688 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9698d2a0-f110-467e-9b7c-ce24311afac2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:25.636535 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9698d2a0-f110-467e-9b7c-ce24311afac2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:25.638122 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9698d2a0-f110-467e-9b7c-ce24311afac2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:25.854187 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-9698d2a0-f110-467e-9b7c-ce24311afac2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:25.863816 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-9698d2a0-f110-467e-9b7c-ce24311afac2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1510 microversion: 2.1 time: 0.242518 Oct 24 13:14:25.864846 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 119/226] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:25 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1510 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:26.008737 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-e14ed7c4-2020-4f05-9d23-f92b90f724c6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:26.009408 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-e14ed7c4-2020-4f05-9d23-f92b90f724c6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:26.015703 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e14ed7c4-2020-4f05-9d23-f92b90f724c6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:26.016199 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e14ed7c4-2020-4f05-9d23-f92b90f724c6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:26.016631 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e14ed7c4-2020-4f05-9d23-f92b90f724c6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:26.017317 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e14ed7c4-2020-4f05-9d23-f92b90f724c6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:26.017770 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e14ed7c4-2020-4f05-9d23-f92b90f724c6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:26.018196 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e14ed7c4-2020-4f05-9d23-f92b90f724c6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:26.213275 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-e14ed7c4-2020-4f05-9d23-f92b90f724c6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:26.231460 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-e14ed7c4-2020-4f05-9d23-f92b90f724c6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7" status: 200 len: 1504 microversion: 2.1 time: 0.225947 Oct 24 13:14:26.232275 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 108/227] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:26 2022] GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 => generated 1504 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:26.322098 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-364a803b-4e1b-4d4d-9f69-cb7caa4600d4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:26.322772 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-364a803b-4e1b-4d4d-9f69-cb7caa4600d4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:26.325781 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:26.331625 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-364a803b-4e1b-4d4d-9f69-cb7caa4600d4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:26.332261 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-364a803b-4e1b-4d4d-9f69-cb7caa4600d4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:26.332807 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-364a803b-4e1b-4d4d-9f69-cb7caa4600d4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:26.333723 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-364a803b-4e1b-4d4d-9f69-cb7caa4600d4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:26.334278 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-364a803b-4e1b-4d4d-9f69-cb7caa4600d4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:26.335091 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-364a803b-4e1b-4d4d-9f69-cb7caa4600d4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:26.481419 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-364a803b-4e1b-4d4d-9f69-cb7caa4600d4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:26.490223 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-364a803b-4e1b-4d4d-9f69-cb7caa4600d4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:26.491859 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-364a803b-4e1b-4d4d-9f69-cb7caa4600d4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:26.493244 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-364a803b-4e1b-4d4d-9f69-cb7caa4600d4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1721 microversion: 2.20 time: 0.175141 Oct 24 13:14:26.494295 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 120/228] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:26 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:14:26.888416 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-73fffa0c-1e80-4b91-ade9-feca7954e91e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:26.888952 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-73fffa0c-1e80-4b91-ade9-feca7954e91e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:26.894891 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-73fffa0c-1e80-4b91-ade9-feca7954e91e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:26.895387 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-73fffa0c-1e80-4b91-ade9-feca7954e91e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:26.895820 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-73fffa0c-1e80-4b91-ade9-feca7954e91e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:26.896506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-73fffa0c-1e80-4b91-ade9-feca7954e91e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:26.896990 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-73fffa0c-1e80-4b91-ade9-feca7954e91e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:26.897420 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-73fffa0c-1e80-4b91-ade9-feca7954e91e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:26.900169 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:27.033687 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-73fffa0c-1e80-4b91-ade9-feca7954e91e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:27.041474 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-73fffa0c-1e80-4b91-ade9-feca7954e91e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1516 microversion: 2.1 time: 0.157784 Oct 24 13:14:27.042104 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 109/229] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:26 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:27.257037 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-10f55533-6125-455d-815a-75598738dbf6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:27.257791 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-10f55533-6125-455d-815a-75598738dbf6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:27.269883 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-10f55533-6125-455d-815a-75598738dbf6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:27.270840 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-10f55533-6125-455d-815a-75598738dbf6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:27.271386 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-10f55533-6125-455d-815a-75598738dbf6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:27.272184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-10f55533-6125-455d-815a-75598738dbf6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:27.272736 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-10f55533-6125-455d-815a-75598738dbf6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:27.273253 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-10f55533-6125-455d-815a-75598738dbf6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:27.417365 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-10f55533-6125-455d-815a-75598738dbf6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:27.425682 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-10f55533-6125-455d-815a-75598738dbf6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7" status: 200 len: 1504 microversion: 2.1 time: 0.172647 Oct 24 13:14:27.426177 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 121/230] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:27 2022] GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:27.521677 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-5bcf1e4e-4c36-4190-abb4-36bebbf0a8ed tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:27.522279 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-5bcf1e4e-4c36-4190-abb4-36bebbf0a8ed tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:27.528792 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5bcf1e4e-4c36-4190-abb4-36bebbf0a8ed tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:27.529265 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5bcf1e4e-4c36-4190-abb4-36bebbf0a8ed tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:27.529690 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5bcf1e4e-4c36-4190-abb4-36bebbf0a8ed tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:27.530368 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5bcf1e4e-4c36-4190-abb4-36bebbf0a8ed tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:27.530813 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5bcf1e4e-4c36-4190-abb4-36bebbf0a8ed tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:27.531265 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5bcf1e4e-4c36-4190-abb4-36bebbf0a8ed tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:27.680696 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-5bcf1e4e-4c36-4190-abb4-36bebbf0a8ed tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:27.689393 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-5bcf1e4e-4c36-4190-abb4-36bebbf0a8ed tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:27.690832 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-5bcf1e4e-4c36-4190-abb4-36bebbf0a8ed tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:27.692015 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-5bcf1e4e-4c36-4190-abb4-36bebbf0a8ed tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1721 microversion: 2.20 time: 0.174267 Oct 24 13:14:27.692579 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 110/231] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:27 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:14:27.946915 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-7b2b025e-70ef-4b9e-bf92-49623ef3d1af tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-294037671", "imageRef": "4d2e5f3e-4aee-48d2-8ada-0b420d141f1b", "flavorRef": "452", "networks": [{"uuid": "016f1aff-2ba1-4abc-bd75-db4946db568d"}]}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:28.001134 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.network.neutron [None req-7b2b025e-70ef-4b9e-bf92-49623ef3d1af tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] validate_networks() for [('016f1aff-2ba1-4abc-bd75-db4946db568d', None, None, None, None, None)] {{(pid=118914) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:14:28.412528 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-717489e2-40f4-4d83-afd0-5a93da29b485 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Action: 'create', calling method: .version_select at 0x7fad287e8790>, body: {"keypair": {"name": "tempest-keypair-1921618364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+B/LnkxYVkZommqjdOif/ffcbgD2sU+I3JjMiPQWeBMdtmWteTjy+xW1r0hKa1z5M6III772zjttV/1nxX+mZKc/iSvJY3tWPLyXNh+7F8KnaETwXfZwID8vOPNJhNUA=="}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:28.436762 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-717489e2-40f4-4d83-afd0-5a93da29b485 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Getting quotas for project 85d62dec32104e7b8c595953a479026b. Resources: {'key_pairs'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:14:28.451636 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-717489e2-40f4-4d83-afd0-5a93da29b485 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Getting quotas for user d29ff25b062346f6bcf9910b1fa8db5c and project 85d62dec32104e7b8c595953a479026b. Resources: {'key_pairs'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:14:28.479711 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-717489e2-40f4-4d83-afd0-5a93da29b485 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070724 Oct 24 13:14:28.481023 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 111/232] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Oct 24 13:14:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:14:28.486366 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8438ee07-f106-4906-8225-f6b5ed433af9 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:28.499769 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-8438ee07-f106-4906-8225-f6b5ed433af9 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:28.508023 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8438ee07-f106-4906-8225-f6b5ed433af9 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:28.508875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8438ee07-f106-4906-8225-f6b5ed433af9 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:28.509462 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8438ee07-f106-4906-8225-f6b5ed433af9 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:28.511346 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8438ee07-f106-4906-8225-f6b5ed433af9 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:28.513311 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8438ee07-f106-4906-8225-f6b5ed433af9 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:28.513857 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8438ee07-f106-4906-8225-f6b5ed433af9 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:28.590802 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-8438ee07-f106-4906-8225-f6b5ed433af9 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:28.601087 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-8438ee07-f106-4906-8225-f6b5ed433af9 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7" status: 200 len: 1462 microversion: 2.1 time: 0.118748 Oct 24 13:14:28.602220 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 112/233] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:28 2022] GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 => generated 1462 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:28.613370 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-7b2b025e-70ef-4b9e-bf92-49623ef3d1af tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Flavor limits 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:14:28.613860 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-7b2b025e-70ef-4b9e-bf92-49623ef3d1af tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Image limits 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:14:28.614262 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-7b2b025e-70ef-4b9e-bf92-49623ef3d1af tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Flavor pref 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:14:28.614668 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-7b2b025e-70ef-4b9e-bf92-49623ef3d1af tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Image pref 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:14:28.614860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-bbd27b42-603c-4883-9160-a9810e33391d req-496c3cc0-19d4-4762-a683-2f97f2b57fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707b11f8-c624-4301-8f29-c0e6ede861f7", "name": "network-vif-deleted", "tag": "2ad53909-5a3a-48e1-98cc-11ccca3e1bd4"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:28.615249 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-7b2b025e-70ef-4b9e-bf92-49623ef3d1af tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:14:28.625760 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7b2b025e-70ef-4b9e-bf92-49623ef3d1af tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:28.626248 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7b2b025e-70ef-4b9e-bf92-49623ef3d1af tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:28.626677 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7b2b025e-70ef-4b9e-bf92-49623ef3d1af tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:28.627431 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7b2b025e-70ef-4b9e-bf92-49623ef3d1af tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:28.627883 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7b2b025e-70ef-4b9e-bf92-49623ef3d1af tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:28.628301 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7b2b025e-70ef-4b9e-bf92-49623ef3d1af tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:28.628567 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-bbd27b42-603c-4883-9160-a9810e33391d req-496c3cc0-19d4-4762-a683-2f97f2b57fd0 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:28.629168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-bbd27b42-603c-4883-9160-a9810e33391d req-496c3cc0-19d4-4762-a683-2f97f2b57fd0 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:28.629695 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-bbd27b42-603c-4883-9160-a9810e33391d req-496c3cc0-19d4-4762-a683-2f97f2b57fd0 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:28.645406 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-bbd27b42-603c-4883-9160-a9810e33391d req-496c3cc0-19d4-4762-a683-2f97f2b57fd0 service nova] Creating event network-vif-deleted:2ad53909-5a3a-48e1-98cc-11ccca3e1bd4 for instance 707b11f8-c624-4301-8f29-c0e6ede861f7 on hv-cinder-86248 Oct 24 13:14:28.646796 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-7b2b025e-70ef-4b9e-bf92-49623ef3d1af tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Getting quotas for project f027aba5a38b422fbc30d64b9ee2ef79. Resources: {'cores', 'instances', 'ram'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:14:28.650995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-7b2b025e-70ef-4b9e-bf92-49623ef3d1af tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Getting quotas for user abd7bde497c14d25a06c276609aa143f and project f027aba5a38b422fbc30d64b9ee2ef79. Resources: {'cores', 'instances', 'ram'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:14:28.651426 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-bbd27b42-603c-4883-9160-a9810e33391d req-496c3cc0-19d4-4762-a683-2f97f2b57fd0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043036 Oct 24 13:14:28.652041 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 113/234] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:14:28.664010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-7b2b025e-70ef-4b9e-bf92-49623ef3d1af tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Going to run 1 instances... {{(pid=118914) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:14:28.666333 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-7b2b025e-70ef-4b9e-bf92-49623ef3d1af tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4d2e5f3e-4aee-48d2-8ada-0b420d141f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:14:28.717986 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-c8b9559d-9415-4001-841f-b6184445aa76 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:28.718865 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-c8b9559d-9415-4001-841f-b6184445aa76 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:28.727747 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c8b9559d-9415-4001-841f-b6184445aa76 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:28.729092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c8b9559d-9415-4001-841f-b6184445aa76 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:28.729530 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c8b9559d-9415-4001-841f-b6184445aa76 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:28.731353 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c8b9559d-9415-4001-841f-b6184445aa76 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:28.732249 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c8b9559d-9415-4001-841f-b6184445aa76 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:28.732757 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c8b9559d-9415-4001-841f-b6184445aa76 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:28.736555 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-7b2b025e-70ef-4b9e-bf92-49623ef3d1af tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793504 Oct 24 13:14:28.737406 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 122/235] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 24 13:14:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:14:28.765537 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-cc094207-5bfd-4981-8750-ab1d672dbac8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:28.766236 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-cc094207-5bfd-4981-8750-ab1d672dbac8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:28.963960 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-c8b9559d-9415-4001-841f-b6184445aa76 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:28.976562 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-c8b9559d-9415-4001-841f-b6184445aa76 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:28.978673 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-c8b9559d-9415-4001-841f-b6184445aa76 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:28.984938 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-c8b9559d-9415-4001-841f-b6184445aa76 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1721 microversion: 2.20 time: 0.266889 Oct 24 13:14:28.985839 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 114/236] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:28 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1721 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:14:29.011321 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-f1114ed2-45ca-47ba-bac4-186f56602651 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Action: 'create', calling method: .version_select at 0x7fad2894eb80>, body: {"keypair": {"name": "tempest-keypair-1561423763", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdxbM8E8IQLeUOzojR1IpadLo0R1RywJKpEVbkHOEdDl2sDwGMWqTlfcBQN+JjlbjyhGkdIr2nb8W1c1Gv5m9vdIwugjD3IOf7KVdv662/p4djYIwTm6DwBZG9Qg1aPug=="}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:29.039130 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-f1114ed2-45ca-47ba-bac4-186f56602651 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Getting quotas for project 69beb82dd21b447d8a784e0570c4323c. Resources: {'key_pairs'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:14:29.051276 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-f1114ed2-45ca-47ba-bac4-186f56602651 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Getting quotas for user c5619c8183e04e1d9073f1b40e057967 and project 69beb82dd21b447d8a784e0570c4323c. Resources: {'key_pairs'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:14:29.089244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-f1114ed2-45ca-47ba-bac4-186f56602651 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.090644 Oct 24 13:14:29.091111 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 115/237] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Oct 24 13:14:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:14:29.124679 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-cc094207-5bfd-4981-8750-ab1d672dbac8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:29.136247 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-cc094207-5bfd-4981-8750-ab1d672dbac8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1218 microversion: 2.1 time: 0.387935 Oct 24 13:14:29.140947 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 123/238] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:28 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1218 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:29.632699 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-667e15f8-5a97-4227-94e6-61e6dc126e3f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:29.635965 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-667e15f8-5a97-4227-94e6-61e6dc126e3f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:29.654630 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-667e15f8-5a97-4227-94e6-61e6dc126e3f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:29.656975 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-667e15f8-5a97-4227-94e6-61e6dc126e3f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:29.657756 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-667e15f8-5a97-4227-94e6-61e6dc126e3f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:29.660612 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-667e15f8-5a97-4227-94e6-61e6dc126e3f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:29.662068 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-667e15f8-5a97-4227-94e6-61e6dc126e3f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:29.663419 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-667e15f8-5a97-4227-94e6-61e6dc126e3f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:29.719889 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-667e15f8-5a97-4227-94e6-61e6dc126e3f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:29.720851 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-667e15f8-5a97-4227-94e6-61e6dc126e3f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:29.721726 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-667e15f8-5a97-4227-94e6-61e6dc126e3f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:29.722352 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.objects.instance [None req-667e15f8-5a97-4227-94e6-61e6dc126e3f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lazy-loading 'fault' on Instance uuid 707b11f8-c624-4301-8f29-c0e6ede861f7 {{(pid=118915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:14:29.829027 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-667e15f8-5a97-4227-94e6-61e6dc126e3f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:29.839044 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-667e15f8-5a97-4227-94e6-61e6dc126e3f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7" status: 200 len: 1304 microversion: 2.1 time: 0.214212 Oct 24 13:14:29.840628 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 116/239] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:29 2022] GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 => generated 1304 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:30.013056 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-05b92acd-79d1-485c-9758-ad5e6511bdbe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:30.014226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-05b92acd-79d1-485c-9758-ad5e6511bdbe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:30.021231 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-05b92acd-79d1-485c-9758-ad5e6511bdbe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:30.022082 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-05b92acd-79d1-485c-9758-ad5e6511bdbe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:30.022670 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-05b92acd-79d1-485c-9758-ad5e6511bdbe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:30.023792 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-05b92acd-79d1-485c-9758-ad5e6511bdbe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:30.024393 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-05b92acd-79d1-485c-9758-ad5e6511bdbe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:30.024961 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-05b92acd-79d1-485c-9758-ad5e6511bdbe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:30.165860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-7e74657b-d3d7-4182-b65c-b8a8fec806db tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:30.166489 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-7e74657b-d3d7-4182-b65c-b8a8fec806db tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:30.173548 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7e74657b-d3d7-4182-b65c-b8a8fec806db tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:30.174379 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7e74657b-d3d7-4182-b65c-b8a8fec806db tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:30.174970 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7e74657b-d3d7-4182-b65c-b8a8fec806db tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:30.175931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7e74657b-d3d7-4182-b65c-b8a8fec806db tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:30.176387 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7e74657b-d3d7-4182-b65c-b8a8fec806db tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:30.176816 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7e74657b-d3d7-4182-b65c-b8a8fec806db tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:30.277441 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-05b92acd-79d1-485c-9758-ad5e6511bdbe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:30.286198 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-05b92acd-79d1-485c-9758-ad5e6511bdbe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:30.287652 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-05b92acd-79d1-485c-9758-ad5e6511bdbe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:30.288930 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-05b92acd-79d1-485c-9758-ad5e6511bdbe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1721 microversion: 2.20 time: 0.281483 Oct 24 13:14:30.289478 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 124/240] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:30 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1721 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:14:30.353796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-7e74657b-d3d7-4182-b65c-b8a8fec806db tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:30.362093 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-7e74657b-d3d7-4182-b65c-b8a8fec806db tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1270 microversion: 2.1 time: 0.200111 Oct 24 13:14:30.362968 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 117/241] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:30 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1270 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:30.744766 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-698a180e-79eb-499e-84e4-4f177b477c97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-948968768", "imageRef": "4d2e5f3e-4aee-48d2-8ada-0b420d141f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "55317d88-e8da-40f9-8cad-037adf7670ee"}], "security_groups": [{"name": "tempest-securitygroup--1431686494"}], "key_name": "tempest-keypair-1921618364", "user_data": "}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:30.864107 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-1cf9ffee-6c6b-4210-9ec6-baeffacef3d5 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:30.864800 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-1cf9ffee-6c6b-4210-9ec6-baeffacef3d5 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 707b11f8-c624-4301-8f29-c0e6ede861f7] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:30.871414 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1cf9ffee-6c6b-4210-9ec6-baeffacef3d5 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:30.871907 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1cf9ffee-6c6b-4210-9ec6-baeffacef3d5 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:30.872342 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1cf9ffee-6c6b-4210-9ec6-baeffacef3d5 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:30.873038 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1cf9ffee-6c6b-4210-9ec6-baeffacef3d5 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:30.873492 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1cf9ffee-6c6b-4210-9ec6-baeffacef3d5 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:30.873916 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1cf9ffee-6c6b-4210-9ec6-baeffacef3d5 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:30.887899 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-1cf9ffee-6c6b-4210-9ec6-baeffacef3d5 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] HTTP exception thrown: Instance 707b11f8-c624-4301-8f29-c0e6ede861f7 could not be found. Oct 24 13:14:30.889531 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-1cf9ffee-6c6b-4210-9ec6-baeffacef3d5 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Request method failure captured: Oct 24 13:14:30.889531 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 HTTP/1.1 Oct 24 13:14:30.889531 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:14:30.889531 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:14:30.889531 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:14:30.889531 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:14:30.889531 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:14:30.889531 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:14:30.889531 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:14:30.889531 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:14:30.889531 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo-a_-W-a1BJ8_1ke14FTmsSNST4NDzvN-EgUSjdLo5evVGWb5w4G0iXTdY9LWqSFvNpAkvyxkLA3sdTRdDS9ZRp6WR6d0wHGHYIcIjhkKtOdAa-FtWo73SI623sg1BGVFkmS7ZAzJ8Ua0sdIh6FaJdpruLuAHLUW_xRWiwzFf4rud8 Oct 24 13:14:30.889531 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:14:30.889531 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:14:30.889531 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:14:30.889531 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:14:30.889531 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:14:30.889531 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:14:30.889531 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: 5b028ba991e14292803f73d38f7003dc Oct 24 13:14:30.889531 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-VolumesActionsTest-1149227572 Oct 24 13:14:30.889531 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:14:30.889531 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:14:30.891030 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5b028ba991e14292803f73d38f7003dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5b028ba991e14292803f73d38f7003dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5b028ba991e14292803f73d38f7003dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5b028ba991e14292803f73d38f7003dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:14:30.891030 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-VolumesActionsTest-1149227572 Oct 24 13:14:30.891030 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: 5b028ba991e14292803f73d38f7003dc Oct 24 13:14:30.891030 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-VolumesActionsTest-1149227572 Oct 24 13:14:30.891030 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-VolumesActionsTest-1149227572-project Oct 24 13:14:30.891030 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:14:30.891030 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:14:30.891030 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: 1fd3d61c9fad4ac8ae26433ec77cd9c8 Oct 24 13:14:30.891030 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-VolumesActionsTest-1149227572-project Oct 24 13:14:30.891030 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:14:30.891030 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Instance 707b11f8-c624-4301-8f29-c0e6ede861f7 could not be found. Oct 24 13:14:30.891030 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': '707b11f8-c624-4301-8f29-c0e6ede861f7'} Oct 24 13:14:30.891833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:14:30.891833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:14:30.891833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:14:30.891833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:14:30.891833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:14:30.891833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:14:30.891833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:14:30.891833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:14:30.891833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:14:30.891833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:14:30.891833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 707b11f8-c624-4301-8f29-c0e6ede861f7 could not be found. Oct 24 13:14:30.891833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:14:30.891833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:14:30.891833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:14:30.891833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:14:30.891833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:14:30.891833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:14:30.891833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:14:30.891833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:14:30.891833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:14:30.892954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:14:30.892954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:14:30.892954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:14:30.892954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:14:30.892954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:14:30.892954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:14:30.892954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:14:30.892954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 707b11f8-c624-4301-8f29-c0e6ede861f7 could not be found. Oct 24 13:14:30.892954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:14:30.892954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:14:30.892954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:14:30.892954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:14:30.892954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:14:30.892954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:14:30.892954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:14:30.892954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:14:30.892954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 707b11f8-c624-4301-8f29-c0e6ede861f7 could not be found. Oct 24 13:14:30.892954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:14:30.893938 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-1cf9ffee-6c6b-4210-9ec6-baeffacef3d5 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Returning 404 to user: Instance 707b11f8-c624-4301-8f29-c0e6ede861f7 could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:14:30.893938 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-1cf9ffee-6c6b-4210-9ec6-baeffacef3d5 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7" status: 404 len: 111 microversion: 2.1 time: 0.030653 Oct 24 13:14:30.893938 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 118/242] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:30 2022] GET /compute/v2.1/servers/707b11f8-c624-4301-8f29-c0e6ede861f7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:14:31.002580 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-4d34e8e6-575b-48a8-805d-2ebf12af5a36 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-561071192", "imageRef": "4d2e5f3e-4aee-48d2-8ada-0b420d141f1b", "flavorRef": "452", "networks": [{"uuid": "d798f212-6307-408f-b9ac-6cfe966ca074"}]}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:31.066699 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.network.neutron [None req-4d34e8e6-575b-48a8-805d-2ebf12af5a36 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] validate_networks() for [('d798f212-6307-408f-b9ac-6cfe966ca074', None, None, None, None, None)] {{(pid=118915) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:14:31.072666 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.network.neutron [None req-698a180e-79eb-499e-84e4-4f177b477c97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] validate_networks() for [('55317d88-e8da-40f9-8cad-037adf7670ee', None, None, None, None, None)] {{(pid=118914) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:14:31.474472 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-4d34e8e6-575b-48a8-805d-2ebf12af5a36 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Flavor limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:14:31.474881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-4d34e8e6-575b-48a8-805d-2ebf12af5a36 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Image limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:14:31.475387 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-4d34e8e6-575b-48a8-805d-2ebf12af5a36 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Flavor pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:14:31.475903 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-4d34e8e6-575b-48a8-805d-2ebf12af5a36 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Image pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:14:31.476182 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-4d34e8e6-575b-48a8-805d-2ebf12af5a36 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:14:31.487038 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4d34e8e6-575b-48a8-805d-2ebf12af5a36 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:31.487764 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4d34e8e6-575b-48a8-805d-2ebf12af5a36 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:31.488350 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4d34e8e6-575b-48a8-805d-2ebf12af5a36 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:31.489216 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4d34e8e6-575b-48a8-805d-2ebf12af5a36 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:31.490056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4d34e8e6-575b-48a8-805d-2ebf12af5a36 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:31.490636 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4d34e8e6-575b-48a8-805d-2ebf12af5a36 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:31.507967 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-4d34e8e6-575b-48a8-805d-2ebf12af5a36 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Getting quotas for project 5b028ba991e14292803f73d38f7003dc. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:14:31.510741 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:31.515364 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-4d34e8e6-575b-48a8-805d-2ebf12af5a36 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Getting quotas for user 1fd3d61c9fad4ac8ae26433ec77cd9c8 and project 5b028ba991e14292803f73d38f7003dc. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:14:31.530900 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-4d34e8e6-575b-48a8-805d-2ebf12af5a36 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Going to run 1 instances... {{(pid=118915) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:14:31.533530 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-4d34e8e6-575b-48a8-805d-2ebf12af5a36 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4d2e5f3e-4aee-48d2-8ada-0b420d141f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:14:31.602548 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-4d34e8e6-575b-48a8-805d-2ebf12af5a36 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603798 Oct 24 13:14:31.603797 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 119/243] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 24 13:14:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 13:14:31.616786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8dd03ce4-abde-4405-8b74-fd4a52069f88 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:31.617678 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-8dd03ce4-abde-4405-8b74-fd4a52069f88 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:31.628331 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8dd03ce4-abde-4405-8b74-fd4a52069f88 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:31.628992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8dd03ce4-abde-4405-8b74-fd4a52069f88 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:31.630145 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8dd03ce4-abde-4405-8b74-fd4a52069f88 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:31.631027 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8dd03ce4-abde-4405-8b74-fd4a52069f88 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:31.631665 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8dd03ce4-abde-4405-8b74-fd4a52069f88 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:31.632239 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8dd03ce4-abde-4405-8b74-fd4a52069f88 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:31.806492 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-8dd03ce4-abde-4405-8b74-fd4a52069f88 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:31.815438 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-8dd03ce4-abde-4405-8b74-fd4a52069f88 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:31.817105 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-8dd03ce4-abde-4405-8b74-fd4a52069f88 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:31.818642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-8dd03ce4-abde-4405-8b74-fd4a52069f88 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1721 microversion: 2.20 time: 0.213671 Oct 24 13:14:31.832391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 120/244] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:31 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:14:31.843509 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9303431d-e01e-4680-99e8-2a7dd90bdfcc tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:31.844056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9303431d-e01e-4680-99e8-2a7dd90bdfcc tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:31.849943 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9303431d-e01e-4680-99e8-2a7dd90bdfcc tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:31.850427 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9303431d-e01e-4680-99e8-2a7dd90bdfcc tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:31.850853 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9303431d-e01e-4680-99e8-2a7dd90bdfcc tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:31.851576 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9303431d-e01e-4680-99e8-2a7dd90bdfcc tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:31.852030 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9303431d-e01e-4680-99e8-2a7dd90bdfcc tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:31.852455 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9303431d-e01e-4680-99e8-2a7dd90bdfcc tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:31.934390 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-9303431d-e01e-4680-99e8-2a7dd90bdfcc tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:31.943946 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-9303431d-e01e-4680-99e8-2a7dd90bdfcc tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1276 microversion: 2.1 time: 0.110296 Oct 24 13:14:31.945090 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 121/245] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:31 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1276 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:31.950133 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-d452089e-bcdd-4cf6-9426-7361a2d600e6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:31.951256 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-d452089e-bcdd-4cf6-9426-7361a2d600e6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:31.968213 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-698a180e-79eb-499e-84e4-4f177b477c97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Flavor limits 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:14:31.968688 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-698a180e-79eb-499e-84e4-4f177b477c97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Image limits 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:14:31.969415 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-698a180e-79eb-499e-84e4-4f177b477c97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Flavor pref 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:14:31.970048 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-698a180e-79eb-499e-84e4-4f177b477c97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Image pref 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:14:31.970612 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-698a180e-79eb-499e-84e4-4f177b477c97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:14:31.983089 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-698a180e-79eb-499e-84e4-4f177b477c97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:31.983781 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-698a180e-79eb-499e-84e4-4f177b477c97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:31.984666 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-698a180e-79eb-499e-84e4-4f177b477c97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:31.985607 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-698a180e-79eb-499e-84e4-4f177b477c97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:31.986246 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-698a180e-79eb-499e-84e4-4f177b477c97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:31.989015 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-698a180e-79eb-499e-84e4-4f177b477c97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:32.010330 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-d452089e-bcdd-4cf6-9426-7361a2d600e6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:32.011934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-698a180e-79eb-499e-84e4-4f177b477c97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Getting quotas for project 85d62dec32104e7b8c595953a479026b. Resources: {'cores', 'instances', 'ram'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:14:32.017458 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-698a180e-79eb-499e-84e4-4f177b477c97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Getting quotas for user d29ff25b062346f6bcf9910b1fa8db5c and project 85d62dec32104e7b8c595953a479026b. Resources: {'cores', 'instances', 'ram'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:14:32.020063 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-d452089e-bcdd-4cf6-9426-7361a2d600e6 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541" status: 200 len: 1213 microversion: 2.1 time: 0.073659 Oct 24 13:14:32.021126 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 122/246] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:31 2022] GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:32.027552 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-0b67a89a-c9a2-41fa-972e-82a2fb3f7ae9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1297078997", "imageRef": "4d2e5f3e-4aee-48d2-8ada-0b420d141f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a05f0bd2-3e3c-4265-bb55-173e62bd1853"}], "security_groups": [{"name": "tempest-securitygroup--1202538341"}], "key_name": "tempest-keypair-1561423763", "user_data": "}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:32.051571 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-698a180e-79eb-499e-84e4-4f177b477c97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Going to run 1 instances... {{(pid=118914) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:14:32.054031 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-698a180e-79eb-499e-84e4-4f177b477c97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4d2e5f3e-4aee-48d2-8ada-0b420d141f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:14:32.125572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-698a180e-79eb-499e-84e4-4f177b477c97 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.385019 Oct 24 13:14:32.126283 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 125/247] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 24 13:14:30 2022] POST /compute/v2.1/servers => generated 409 bytes in 1387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 24 13:14:32.138854 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-2921d29c-aca2-4742-829b-454fe485bf6a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:32.139718 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-2921d29c-aca2-4742-829b-454fe485bf6a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:32.148805 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.network.neutron [None req-0b67a89a-c9a2-41fa-972e-82a2fb3f7ae9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] validate_networks() for [('a05f0bd2-3e3c-4265-bb55-173e62bd1853', None, None, None, None, None)] {{(pid=118915) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:14:32.212035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-2921d29c-aca2-4742-829b-454fe485bf6a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:32.223020 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-2921d29c-aca2-4742-829b-454fe485bf6a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1245 microversion: 2.1 time: 0.089314 Oct 24 13:14:32.225075 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 126/248] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:32 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:32.644036 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-0b67a89a-c9a2-41fa-972e-82a2fb3f7ae9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Flavor limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:14:32.644644 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-0b67a89a-c9a2-41fa-972e-82a2fb3f7ae9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Image limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:14:32.645269 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-0b67a89a-c9a2-41fa-972e-82a2fb3f7ae9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Flavor pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:14:32.645845 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-0b67a89a-c9a2-41fa-972e-82a2fb3f7ae9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Image pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:14:32.646261 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-0b67a89a-c9a2-41fa-972e-82a2fb3f7ae9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:14:32.654969 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b67a89a-c9a2-41fa-972e-82a2fb3f7ae9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:32.655546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b67a89a-c9a2-41fa-972e-82a2fb3f7ae9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:32.656655 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b67a89a-c9a2-41fa-972e-82a2fb3f7ae9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:32.657383 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b67a89a-c9a2-41fa-972e-82a2fb3f7ae9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:32.657826 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b67a89a-c9a2-41fa-972e-82a2fb3f7ae9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:32.658524 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b67a89a-c9a2-41fa-972e-82a2fb3f7ae9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:32.698386 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-0b67a89a-c9a2-41fa-972e-82a2fb3f7ae9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Getting quotas for project 69beb82dd21b447d8a784e0570c4323c. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:14:32.702751 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-0b67a89a-c9a2-41fa-972e-82a2fb3f7ae9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Getting quotas for user c5619c8183e04e1d9073f1b40e057967 and project 69beb82dd21b447d8a784e0570c4323c. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:14:32.717039 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-0b67a89a-c9a2-41fa-972e-82a2fb3f7ae9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Going to run 1 instances... {{(pid=118915) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:14:32.720034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-0b67a89a-c9a2-41fa-972e-82a2fb3f7ae9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4d2e5f3e-4aee-48d2-8ada-0b420d141f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:14:32.783556 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-0b67a89a-c9a2-41fa-972e-82a2fb3f7ae9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.761189 Oct 24 13:14:32.784198 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 123/249] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 24 13:14:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:14:32.795884 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-785a50bf-5516-4712-9584-e1dc8852b008 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:32.796663 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-785a50bf-5516-4712-9584-e1dc8852b008 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:32.847192 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-897086de-3020-4b78-aea8-95c1f6e467d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:32.847827 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-897086de-3020-4b78-aea8-95c1f6e467d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:32.854093 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-897086de-3020-4b78-aea8-95c1f6e467d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:32.854575 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-897086de-3020-4b78-aea8-95c1f6e467d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:32.855044 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-897086de-3020-4b78-aea8-95c1f6e467d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:32.856286 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-897086de-3020-4b78-aea8-95c1f6e467d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:32.856737 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-897086de-3020-4b78-aea8-95c1f6e467d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:32.857156 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-897086de-3020-4b78-aea8-95c1f6e467d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:32.874929 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-785a50bf-5516-4712-9584-e1dc8852b008 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:32.885580 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-785a50bf-5516-4712-9584-e1dc8852b008 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1242 microversion: 2.1 time: 0.093118 Oct 24 13:14:32.899079 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 127/250] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:32 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:32.970156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-3a2e8770-e47c-4358-bf4c-d5ef1eade92f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:32.970776 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-3a2e8770-e47c-4358-bf4c-d5ef1eade92f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:32.977146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3a2e8770-e47c-4358-bf4c-d5ef1eade92f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:32.977745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3a2e8770-e47c-4358-bf4c-d5ef1eade92f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:32.978308 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3a2e8770-e47c-4358-bf4c-d5ef1eade92f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:32.979003 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3a2e8770-e47c-4358-bf4c-d5ef1eade92f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:32.979476 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3a2e8770-e47c-4358-bf4c-d5ef1eade92f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:32.979891 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3a2e8770-e47c-4358-bf4c-d5ef1eade92f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:33.017806 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-897086de-3020-4b78-aea8-95c1f6e467d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:33.028270 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-897086de-3020-4b78-aea8-95c1f6e467d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:33.030132 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-897086de-3020-4b78-aea8-95c1f6e467d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:33.031942 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-897086de-3020-4b78-aea8-95c1f6e467d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1721 microversion: 2.20 time: 0.188645 Oct 24 13:14:33.033106 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 124/251] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:32 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:14:33.061064 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-2e692afe-1227-46dd-8212-cd4e8d50221f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:33.062047 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-2e692afe-1227-46dd-8212-cd4e8d50221f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:33.070874 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2e692afe-1227-46dd-8212-cd4e8d50221f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:33.071841 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2e692afe-1227-46dd-8212-cd4e8d50221f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:33.072680 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2e692afe-1227-46dd-8212-cd4e8d50221f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:33.073662 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2e692afe-1227-46dd-8212-cd4e8d50221f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:33.074406 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2e692afe-1227-46dd-8212-cd4e8d50221f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:33.075391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2e692afe-1227-46dd-8212-cd4e8d50221f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:33.172592 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-2e692afe-1227-46dd-8212-cd4e8d50221f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:33.191010 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-2e692afe-1227-46dd-8212-cd4e8d50221f tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541" status: 200 len: 1265 microversion: 2.1 time: 0.138051 Oct 24 13:14:33.191648 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 125/252] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:33 2022] GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541 => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:33.249666 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-242d1074-88ad-4c16-9d36-6e17947d83f0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:33.250397 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-242d1074-88ad-4c16-9d36-6e17947d83f0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:33.273407 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-242d1074-88ad-4c16-9d36-6e17947d83f0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:33.273973 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-242d1074-88ad-4c16-9d36-6e17947d83f0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:33.274340 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-242d1074-88ad-4c16-9d36-6e17947d83f0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:33.275065 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-242d1074-88ad-4c16-9d36-6e17947d83f0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:33.275605 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-242d1074-88ad-4c16-9d36-6e17947d83f0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:33.275962 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-242d1074-88ad-4c16-9d36-6e17947d83f0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:33.380036 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-242d1074-88ad-4c16-9d36-6e17947d83f0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:33.391781 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-242d1074-88ad-4c16-9d36-6e17947d83f0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1297 microversion: 2.1 time: 0.147429 Oct 24 13:14:33.392558 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 126/253] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:33 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1297 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:33.538724 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-a2945d73-0490-4f1f-8a1e-4954778ec0c6 req-c1c38435-3153-4e6e-a6f6-267952ba65f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24354cc9-2856-455f-b89e-cd913ef97dde", "tag": "e9210097-debc-417e-a4c0-33a08dd9bfd8"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:33.555433 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-a2945d73-0490-4f1f-8a1e-4954778ec0c6 req-c1c38435-3153-4e6e-a6f6-267952ba65f7 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:33.556354 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-a2945d73-0490-4f1f-8a1e-4954778ec0c6 req-c1c38435-3153-4e6e-a6f6-267952ba65f7 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:33.557101 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-a2945d73-0490-4f1f-8a1e-4954778ec0c6 req-c1c38435-3153-4e6e-a6f6-267952ba65f7 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:33.572735 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-a2945d73-0490-4f1f-8a1e-4954778ec0c6 req-c1c38435-3153-4e6e-a6f6-267952ba65f7 service nova] Creating event network-changed:e9210097-debc-417e-a4c0-33a08dd9bfd8 for instance 24354cc9-2856-455f-b89e-cd913ef97dde on hv-cinder-86248 Oct 24 13:14:33.578902 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-a2945d73-0490-4f1f-8a1e-4954778ec0c6 req-c1c38435-3153-4e6e-a6f6-267952ba65f7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047968 Oct 24 13:14:33.579647 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 127/254] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:14:33.674699 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-3a2e8770-e47c-4358-bf4c-d5ef1eade92f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:33.682360 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-3a2e8770-e47c-4358-bf4c-d5ef1eade92f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1318 microversion: 2.1 time: 0.718748 Oct 24 13:14:33.682919 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 128/255] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:32 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1318 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:33.913646 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-0b7e0de6-e4ae-40cb-947e-85003861b260 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:33.914632 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-0b7e0de6-e4ae-40cb-947e-85003861b260 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:33.922410 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b7e0de6-e4ae-40cb-947e-85003861b260 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:33.923213 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b7e0de6-e4ae-40cb-947e-85003861b260 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:33.923855 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b7e0de6-e4ae-40cb-947e-85003861b260 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:33.924778 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b7e0de6-e4ae-40cb-947e-85003861b260 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:33.925449 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b7e0de6-e4ae-40cb-947e-85003861b260 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:33.926070 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b7e0de6-e4ae-40cb-947e-85003861b260 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:34.026438 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-0b7e0de6-e4ae-40cb-947e-85003861b260 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:34.036912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-0b7e0de6-e4ae-40cb-947e-85003861b260 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1238 microversion: 2.1 time: 0.128137 Oct 24 13:14:34.040960 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 128/256] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:33 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1238 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:34.066851 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-40a90651-93ae-4bcb-bbb7-5052326bdd04 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:34.067562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-40a90651-93ae-4bcb-bbb7-5052326bdd04 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:34.083552 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40a90651-93ae-4bcb-bbb7-5052326bdd04 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:34.084107 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40a90651-93ae-4bcb-bbb7-5052326bdd04 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:34.084547 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40a90651-93ae-4bcb-bbb7-5052326bdd04 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:34.085306 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40a90651-93ae-4bcb-bbb7-5052326bdd04 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:34.088375 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40a90651-93ae-4bcb-bbb7-5052326bdd04 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:34.089009 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40a90651-93ae-4bcb-bbb7-5052326bdd04 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:34.216077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-ef915ac3-7372-471d-b689-41a6d0672f72 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:34.216731 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-ef915ac3-7372-471d-b689-41a6d0672f72 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:34.224190 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ef915ac3-7372-471d-b689-41a6d0672f72 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:34.224859 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ef915ac3-7372-471d-b689-41a6d0672f72 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:34.225395 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ef915ac3-7372-471d-b689-41a6d0672f72 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:34.226172 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ef915ac3-7372-471d-b689-41a6d0672f72 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:34.226826 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ef915ac3-7372-471d-b689-41a6d0672f72 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:34.227304 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ef915ac3-7372-471d-b689-41a6d0672f72 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:34.298722 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-ef915ac3-7372-471d-b689-41a6d0672f72 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:34.307648 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-ef915ac3-7372-471d-b689-41a6d0672f72 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541" status: 200 len: 1271 microversion: 2.1 time: 0.097662 Oct 24 13:14:34.308217 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 129/257] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:34 2022] GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541 => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:34.419574 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-0c4a9ed7-7691-45ac-9711-e88b1826bbd8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:34.421390 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-0c4a9ed7-7691-45ac-9711-e88b1826bbd8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:34.431678 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0c4a9ed7-7691-45ac-9711-e88b1826bbd8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:34.432205 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0c4a9ed7-7691-45ac-9711-e88b1826bbd8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:34.433251 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0c4a9ed7-7691-45ac-9711-e88b1826bbd8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:34.434680 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0c4a9ed7-7691-45ac-9711-e88b1826bbd8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:34.435178 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0c4a9ed7-7691-45ac-9711-e88b1826bbd8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:34.436050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0c4a9ed7-7691-45ac-9711-e88b1826bbd8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:34.498925 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-40a90651-93ae-4bcb-bbb7-5052326bdd04 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:34.508199 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-40a90651-93ae-4bcb-bbb7-5052326bdd04 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:34.509884 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-40a90651-93ae-4bcb-bbb7-5052326bdd04 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:34.511363 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-40a90651-93ae-4bcb-bbb7-5052326bdd04 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1721 microversion: 2.20 time: 0.454633 Oct 24 13:14:34.512000 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 129/258] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:34 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1721 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:14:34.544033 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-0c4a9ed7-7691-45ac-9711-e88b1826bbd8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:34.552844 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-0c4a9ed7-7691-45ac-9711-e88b1826bbd8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1303 microversion: 2.1 time: 0.140147 Oct 24 13:14:34.560526 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 130/259] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:34 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1303 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:34.706478 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-fb4bac6b-923e-4cff-b1f5-9cf5381a0d8b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:34.708435 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-fb4bac6b-923e-4cff-b1f5-9cf5381a0d8b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:34.714501 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fb4bac6b-923e-4cff-b1f5-9cf5381a0d8b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:34.715256 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fb4bac6b-923e-4cff-b1f5-9cf5381a0d8b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:34.715692 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fb4bac6b-923e-4cff-b1f5-9cf5381a0d8b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:34.716394 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fb4bac6b-923e-4cff-b1f5-9cf5381a0d8b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:34.716849 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fb4bac6b-923e-4cff-b1f5-9cf5381a0d8b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:34.717466 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fb4bac6b-923e-4cff-b1f5-9cf5381a0d8b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:35.001107 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-fb4bac6b-923e-4cff-b1f5-9cf5381a0d8b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:35.009631 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-fb4bac6b-923e-4cff-b1f5-9cf5381a0d8b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1318 microversion: 2.1 time: 0.307101 Oct 24 13:14:35.010496 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 130/260] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:34 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:35.065847 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-81c5ead3-5676-4058-a503-c639d08ffbf9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:35.067251 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-81c5ead3-5676-4058-a503-c639d08ffbf9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:35.074135 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-81c5ead3-5676-4058-a503-c639d08ffbf9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:35.075252 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-81c5ead3-5676-4058-a503-c639d08ffbf9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:35.075725 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-81c5ead3-5676-4058-a503-c639d08ffbf9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:35.076444 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-81c5ead3-5676-4058-a503-c639d08ffbf9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:35.076925 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-81c5ead3-5676-4058-a503-c639d08ffbf9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:35.077374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-81c5ead3-5676-4058-a503-c639d08ffbf9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:35.149897 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-81c5ead3-5676-4058-a503-c639d08ffbf9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:35.152808 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=100 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:35.159317 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-81c5ead3-5676-4058-a503-c639d08ffbf9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1302 microversion: 2.1 time: 0.097469 Oct 24 13:14:35.159890 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 131/261] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:35 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1302 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:35.332580 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-1bc14e12-9b1c-4d2c-bbdf-57a9cd12e779 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:35.333112 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-1bc14e12-9b1c-4d2c-bbdf-57a9cd12e779 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:35.339466 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1bc14e12-9b1c-4d2c-bbdf-57a9cd12e779 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:35.340582 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1bc14e12-9b1c-4d2c-bbdf-57a9cd12e779 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:35.341147 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1bc14e12-9b1c-4d2c-bbdf-57a9cd12e779 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:35.341826 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1bc14e12-9b1c-4d2c-bbdf-57a9cd12e779 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:35.342276 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1bc14e12-9b1c-4d2c-bbdf-57a9cd12e779 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:35.342699 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1bc14e12-9b1c-4d2c-bbdf-57a9cd12e779 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:35.471790 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-1bc14e12-9b1c-4d2c-bbdf-57a9cd12e779 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:35.479217 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-1bc14e12-9b1c-4d2c-bbdf-57a9cd12e779 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541" status: 200 len: 1313 microversion: 2.1 time: 0.150580 Oct 24 13:14:35.479775 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 131/262] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:35 2022] GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:35.538161 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-fdc841ee-7922-45ab-8f6f-dbe2e33292f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:35.538792 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-fdc841ee-7922-45ab-8f6f-dbe2e33292f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:35.545639 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fdc841ee-7922-45ab-8f6f-dbe2e33292f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:35.546136 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fdc841ee-7922-45ab-8f6f-dbe2e33292f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:35.546593 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fdc841ee-7922-45ab-8f6f-dbe2e33292f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:35.547321 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fdc841ee-7922-45ab-8f6f-dbe2e33292f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:35.547802 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fdc841ee-7922-45ab-8f6f-dbe2e33292f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:35.548246 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fdc841ee-7922-45ab-8f6f-dbe2e33292f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:35.577131 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-4de8ba7f-8170-41e0-b878-c37b68e239df tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:35.577740 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-4de8ba7f-8170-41e0-b878-c37b68e239df tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:35.583699 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4de8ba7f-8170-41e0-b878-c37b68e239df tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:35.584116 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4de8ba7f-8170-41e0-b878-c37b68e239df tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:35.584549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4de8ba7f-8170-41e0-b878-c37b68e239df tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:35.585234 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4de8ba7f-8170-41e0-b878-c37b68e239df tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:35.585774 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4de8ba7f-8170-41e0-b878-c37b68e239df tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:35.586184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4de8ba7f-8170-41e0-b878-c37b68e239df tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:35.680768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-fdc841ee-7922-45ab-8f6f-dbe2e33292f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:35.690477 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-fdc841ee-7922-45ab-8f6f-dbe2e33292f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:35.691972 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-fdc841ee-7922-45ab-8f6f-dbe2e33292f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:35.693171 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-fdc841ee-7922-45ab-8f6f-dbe2e33292f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1721 microversion: 2.20 time: 0.159076 Oct 24 13:14:35.693731 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 132/263] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:35 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:14:35.715377 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-4de8ba7f-8170-41e0-b878-c37b68e239df tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:35.722756 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-4de8ba7f-8170-41e0-b878-c37b68e239df tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1371 microversion: 2.1 time: 0.150136 Oct 24 13:14:35.723335 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 132/264] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:35 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:36.032195 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-4a1e192a-bba6-4479-86cf-88bf3f88c25a tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:36.032899 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-4a1e192a-bba6-4479-86cf-88bf3f88c25a tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:36.039282 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4a1e192a-bba6-4479-86cf-88bf3f88c25a tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:36.039764 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4a1e192a-bba6-4479-86cf-88bf3f88c25a tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:36.040198 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4a1e192a-bba6-4479-86cf-88bf3f88c25a tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:36.040884 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4a1e192a-bba6-4479-86cf-88bf3f88c25a tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:36.041336 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4a1e192a-bba6-4479-86cf-88bf3f88c25a tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:36.041757 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4a1e192a-bba6-4479-86cf-88bf3f88c25a tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:36.182627 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-28f999d7-2751-4f9a-ab26-d608a1047483 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:36.185130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-28f999d7-2751-4f9a-ab26-d608a1047483 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:36.191833 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-28f999d7-2751-4f9a-ab26-d608a1047483 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:36.192617 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-28f999d7-2751-4f9a-ab26-d608a1047483 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:36.193248 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-28f999d7-2751-4f9a-ab26-d608a1047483 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:36.194305 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-28f999d7-2751-4f9a-ab26-d608a1047483 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:36.194840 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-28f999d7-2751-4f9a-ab26-d608a1047483 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:36.195340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-28f999d7-2751-4f9a-ab26-d608a1047483 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:36.301824 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-28f999d7-2751-4f9a-ab26-d608a1047483 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:36.310720 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-28f999d7-2751-4f9a-ab26-d608a1047483 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1300 microversion: 2.1 time: 0.131806 Oct 24 13:14:36.311914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 133/265] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:36 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1300 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:36.358827 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-4a1e192a-bba6-4479-86cf-88bf3f88c25a tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:36.368648 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-4a1e192a-bba6-4479-86cf-88bf3f88c25a tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1318 microversion: 2.1 time: 0.340187 Oct 24 13:14:36.369461 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 133/266] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:36 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:36.503087 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a4de1101-1c36-4fc6-b5b9-aee1a09314bb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:36.503927 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a4de1101-1c36-4fc6-b5b9-aee1a09314bb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:36.510930 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4de1101-1c36-4fc6-b5b9-aee1a09314bb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:36.511982 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4de1101-1c36-4fc6-b5b9-aee1a09314bb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:36.512818 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4de1101-1c36-4fc6-b5b9-aee1a09314bb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:36.513518 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4de1101-1c36-4fc6-b5b9-aee1a09314bb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:36.515271 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4de1101-1c36-4fc6-b5b9-aee1a09314bb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:36.515811 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4de1101-1c36-4fc6-b5b9-aee1a09314bb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:36.719366 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-b2fb7db2-139b-45b0-ab49-f40930a84ea6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:36.719994 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-b2fb7db2-139b-45b0-ab49-f40930a84ea6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:36.727256 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b2fb7db2-139b-45b0-ab49-f40930a84ea6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:36.727996 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b2fb7db2-139b-45b0-ab49-f40930a84ea6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:36.729028 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b2fb7db2-139b-45b0-ab49-f40930a84ea6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:36.730126 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b2fb7db2-139b-45b0-ab49-f40930a84ea6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:36.731444 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b2fb7db2-139b-45b0-ab49-f40930a84ea6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:36.731874 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b2fb7db2-139b-45b0-ab49-f40930a84ea6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:36.786597 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a4de1101-1c36-4fc6-b5b9-aee1a09314bb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:36.796717 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a4de1101-1c36-4fc6-b5b9-aee1a09314bb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541" status: 200 len: 1313 microversion: 2.1 time: 0.297926 Oct 24 13:14:36.811588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 134/267] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:36 2022] GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:36.817020 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-07a43886-99b2-4ff8-9d48-bb7d37999a8c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:36.817752 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-07a43886-99b2-4ff8-9d48-bb7d37999a8c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:36.826975 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-07a43886-99b2-4ff8-9d48-bb7d37999a8c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:36.828175 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-07a43886-99b2-4ff8-9d48-bb7d37999a8c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:36.828791 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-07a43886-99b2-4ff8-9d48-bb7d37999a8c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:36.829495 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-07a43886-99b2-4ff8-9d48-bb7d37999a8c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:36.829951 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-07a43886-99b2-4ff8-9d48-bb7d37999a8c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:36.830537 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-07a43886-99b2-4ff8-9d48-bb7d37999a8c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:37.037805 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-b2fb7db2-139b-45b0-ab49-f40930a84ea6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:37.048038 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-b2fb7db2-139b-45b0-ab49-f40930a84ea6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:37.050045 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-b2fb7db2-139b-45b0-ab49-f40930a84ea6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:37.051293 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-07a43886-99b2-4ff8-9d48-bb7d37999a8c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:37.051940 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-b2fb7db2-139b-45b0-ab49-f40930a84ea6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1721 microversion: 2.20 time: 0.337473 Oct 24 13:14:37.071755 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-07a43886-99b2-4ff8-9d48-bb7d37999a8c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1371 microversion: 2.1 time: 0.260730 Oct 24 13:14:37.073204 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 135/268] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:36 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:37.092358 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-2885689d-b5c4-46a0-8ae8-85074967cc49 req-32fe4d55-878d-4ed0-8ee5-8908ca95bd67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76c60f48-8ebd-45ea-880a-c786cf73b541", "tag": "71e22cc0-7b16-4e0f-bd74-9915e3a6bc11"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:37.106734 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 134/269] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:36 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1721 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:14:37.116464 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-2885689d-b5c4-46a0-8ae8-85074967cc49 req-32fe4d55-878d-4ed0-8ee5-8908ca95bd67 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:37.118878 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-661f3af6-f1b4-4c82-aa80-f6ae044e230d req-a3964ae6-9ff0-44be-af53-f68378a08fcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bd238e2-4223-465c-8028-c291fe1db874", "tag": "b1289f23-07a5-45c6-9004-035914303827"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:37.119693 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-2885689d-b5c4-46a0-8ae8-85074967cc49 req-32fe4d55-878d-4ed0-8ee5-8908ca95bd67 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:37.120598 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-2885689d-b5c4-46a0-8ae8-85074967cc49 req-32fe4d55-878d-4ed0-8ee5-8908ca95bd67 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:37.147076 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-661f3af6-f1b4-4c82-aa80-f6ae044e230d req-a3964ae6-9ff0-44be-af53-f68378a08fcb service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:37.149949 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-2885689d-b5c4-46a0-8ae8-85074967cc49 req-32fe4d55-878d-4ed0-8ee5-8908ca95bd67 service nova] Creating event network-changed:71e22cc0-7b16-4e0f-bd74-9915e3a6bc11 for instance 76c60f48-8ebd-45ea-880a-c786cf73b541 on hv-cinder-86248 Oct 24 13:14:37.151627 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-661f3af6-f1b4-4c82-aa80-f6ae044e230d req-a3964ae6-9ff0-44be-af53-f68378a08fcb service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:37.153481 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-661f3af6-f1b4-4c82-aa80-f6ae044e230d req-a3964ae6-9ff0-44be-af53-f68378a08fcb service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:37.162295 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-2885689d-b5c4-46a0-8ae8-85074967cc49 req-32fe4d55-878d-4ed0-8ee5-8908ca95bd67 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085617 Oct 24 13:14:37.162776 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 136/270] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:14:37.171647 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-661f3af6-f1b4-4c82-aa80-f6ae044e230d req-a3964ae6-9ff0-44be-af53-f68378a08fcb service nova] Creating event network-changed:b1289f23-07a5-45c6-9004-035914303827 for instance 6bd238e2-4223-465c-8028-c291fe1db874 on hv-cinder-86248 Oct 24 13:14:37.176639 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-661f3af6-f1b4-4c82-aa80-f6ae044e230d req-a3964ae6-9ff0-44be-af53-f68378a08fcb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063927 Oct 24 13:14:37.181419 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 135/271] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:14:37.342809 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-e621ca5b-456f-41b8-a277-ce10badfc50d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:37.343813 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-e621ca5b-456f-41b8-a277-ce10badfc50d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:37.350901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e621ca5b-456f-41b8-a277-ce10badfc50d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:37.351670 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e621ca5b-456f-41b8-a277-ce10badfc50d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:37.352289 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e621ca5b-456f-41b8-a277-ce10badfc50d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:37.353149 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e621ca5b-456f-41b8-a277-ce10badfc50d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:37.353755 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e621ca5b-456f-41b8-a277-ce10badfc50d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:37.354365 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e621ca5b-456f-41b8-a277-ce10badfc50d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:37.392768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-35cb36cf-1ec9-4429-873b-fc5eeadef49c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:37.394291 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-35cb36cf-1ec9-4429-873b-fc5eeadef49c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:37.401409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-35cb36cf-1ec9-4429-873b-fc5eeadef49c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:37.402061 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-35cb36cf-1ec9-4429-873b-fc5eeadef49c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:37.402874 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-35cb36cf-1ec9-4429-873b-fc5eeadef49c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:37.403891 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-35cb36cf-1ec9-4429-873b-fc5eeadef49c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:37.404450 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-35cb36cf-1ec9-4429-873b-fc5eeadef49c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:37.404978 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-35cb36cf-1ec9-4429-873b-fc5eeadef49c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:37.819436 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-e621ca5b-456f-41b8-a277-ce10badfc50d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:37.826378 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-35cb36cf-1ec9-4429-873b-fc5eeadef49c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:37.835318 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-e621ca5b-456f-41b8-a277-ce10badfc50d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1368 microversion: 2.1 time: 0.502885 Oct 24 13:14:37.839301 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 137/272] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:37 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1368 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:37.846437 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-8c8d7ad9-e4ce-4516-a121-d2cb7726419c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:37.851386 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-8c8d7ad9-e4ce-4516-a121-d2cb7726419c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:37.854820 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-35cb36cf-1ec9-4429-873b-fc5eeadef49c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1318 microversion: 2.1 time: 0.466083 Oct 24 13:14:37.858307 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 136/273] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:37 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1318 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:37.870680 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8c8d7ad9-e4ce-4516-a121-d2cb7726419c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:37.871606 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8c8d7ad9-e4ce-4516-a121-d2cb7726419c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:37.874841 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8c8d7ad9-e4ce-4516-a121-d2cb7726419c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:37.875591 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8c8d7ad9-e4ce-4516-a121-d2cb7726419c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:37.876048 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8c8d7ad9-e4ce-4516-a121-d2cb7726419c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:37.876487 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8c8d7ad9-e4ce-4516-a121-d2cb7726419c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:38.026812 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-8c8d7ad9-e4ce-4516-a121-d2cb7726419c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:38.033324 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=100 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:38.044343 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-8c8d7ad9-e4ce-4516-a121-d2cb7726419c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541" status: 200 len: 1313 microversion: 2.1 time: 0.203186 Oct 24 13:14:38.044983 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 138/274] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:37 2022] GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:38.078552 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-eb848986-7ed2-49db-bbd2-acb39fd6aef7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:38.079310 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-eb848986-7ed2-49db-bbd2-acb39fd6aef7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:38.085340 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-eb848986-7ed2-49db-bbd2-acb39fd6aef7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:38.085823 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-eb848986-7ed2-49db-bbd2-acb39fd6aef7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:38.086251 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-eb848986-7ed2-49db-bbd2-acb39fd6aef7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:38.086939 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-eb848986-7ed2-49db-bbd2-acb39fd6aef7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:38.087423 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-eb848986-7ed2-49db-bbd2-acb39fd6aef7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:38.087844 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-eb848986-7ed2-49db-bbd2-acb39fd6aef7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:38.114281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-0dd47742-cd81-40bf-b8fd-0f74e4f7b97d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:38.114902 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-0dd47742-cd81-40bf-b8fd-0f74e4f7b97d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:38.121378 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0dd47742-cd81-40bf-b8fd-0f74e4f7b97d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:38.121874 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0dd47742-cd81-40bf-b8fd-0f74e4f7b97d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:38.122338 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0dd47742-cd81-40bf-b8fd-0f74e4f7b97d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:38.123044 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0dd47742-cd81-40bf-b8fd-0f74e4f7b97d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:38.123556 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0dd47742-cd81-40bf-b8fd-0f74e4f7b97d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:38.123985 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0dd47742-cd81-40bf-b8fd-0f74e4f7b97d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:38.259702 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-0dd47742-cd81-40bf-b8fd-0f74e4f7b97d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:38.268839 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-0dd47742-cd81-40bf-b8fd-0f74e4f7b97d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1371 microversion: 2.1 time: 0.158904 Oct 24 13:14:38.269351 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 139/275] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:38 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:38.309280 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-eb848986-7ed2-49db-bbd2-acb39fd6aef7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:38.318359 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-eb848986-7ed2-49db-bbd2-acb39fd6aef7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:38.320669 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-eb848986-7ed2-49db-bbd2-acb39fd6aef7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:38.322068 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-eb848986-7ed2-49db-bbd2-acb39fd6aef7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1742 microversion: 2.20 time: 0.248190 Oct 24 13:14:38.322842 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 137/276] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:38 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1742 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:14:38.862903 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-8fcea3f5-db2b-49a7-a118-d8bea4dbd476 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:38.863546 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-8fcea3f5-db2b-49a7-a118-d8bea4dbd476 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:38.869982 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8fcea3f5-db2b-49a7-a118-d8bea4dbd476 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:38.870461 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8fcea3f5-db2b-49a7-a118-d8bea4dbd476 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:38.871637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8fcea3f5-db2b-49a7-a118-d8bea4dbd476 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:38.872313 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8fcea3f5-db2b-49a7-a118-d8bea4dbd476 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:38.872765 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8fcea3f5-db2b-49a7-a118-d8bea4dbd476 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:38.873184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8fcea3f5-db2b-49a7-a118-d8bea4dbd476 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:38.879281 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-e8aebd4f-ee67-468a-9d83-ea6acd6c98a1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:38.879893 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-e8aebd4f-ee67-468a-9d83-ea6acd6c98a1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:38.886704 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e8aebd4f-ee67-468a-9d83-ea6acd6c98a1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:38.887380 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e8aebd4f-ee67-468a-9d83-ea6acd6c98a1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:38.887828 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e8aebd4f-ee67-468a-9d83-ea6acd6c98a1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:38.888537 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e8aebd4f-ee67-468a-9d83-ea6acd6c98a1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:38.888988 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e8aebd4f-ee67-468a-9d83-ea6acd6c98a1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:38.889412 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e8aebd4f-ee67-468a-9d83-ea6acd6c98a1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:39.003463 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-8fcea3f5-db2b-49a7-a118-d8bea4dbd476 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:39.011551 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-8fcea3f5-db2b-49a7-a118-d8bea4dbd476 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1368 microversion: 2.1 time: 0.152295 Oct 24 13:14:39.012113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 140/277] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:38 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:39.022325 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-e8aebd4f-ee67-468a-9d83-ea6acd6c98a1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:39.030466 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-e8aebd4f-ee67-468a-9d83-ea6acd6c98a1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1318 microversion: 2.1 time: 0.155058 Oct 24 13:14:39.031023 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 138/278] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:38 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:39.066686 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-20066949-dce4-4e0c-9605-42b2ff9eba8d tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:39.067252 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-20066949-dce4-4e0c-9605-42b2ff9eba8d tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:39.073428 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-20066949-dce4-4e0c-9605-42b2ff9eba8d tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:39.073913 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-20066949-dce4-4e0c-9605-42b2ff9eba8d tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:39.074401 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-20066949-dce4-4e0c-9605-42b2ff9eba8d tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:39.075319 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-20066949-dce4-4e0c-9605-42b2ff9eba8d tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:39.075783 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-20066949-dce4-4e0c-9605-42b2ff9eba8d tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:39.076202 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-20066949-dce4-4e0c-9605-42b2ff9eba8d tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:39.214027 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-2ba6ac69-10f3-46e3-9a5f-d59ace305b10 req-b3d80b76-b101-419d-91aa-f9b1f25daef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc138711-ddfb-4b61-bf88-532641a857cd", "tag": "37f90190-526c-4317-90a1-c6197bdf36c1"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:39.225079 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-2ba6ac69-10f3-46e3-9a5f-d59ace305b10 req-b3d80b76-b101-419d-91aa-f9b1f25daef6 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:39.225638 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-2ba6ac69-10f3-46e3-9a5f-d59ace305b10 req-b3d80b76-b101-419d-91aa-f9b1f25daef6 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:39.226140 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-2ba6ac69-10f3-46e3-9a5f-d59ace305b10 req-b3d80b76-b101-419d-91aa-f9b1f25daef6 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:39.238299 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-2ba6ac69-10f3-46e3-9a5f-d59ace305b10 req-b3d80b76-b101-419d-91aa-f9b1f25daef6 service nova] Creating event network-changed:37f90190-526c-4317-90a1-c6197bdf36c1 for instance dc138711-ddfb-4b61-bf88-532641a857cd on hv-cinder-86248 Oct 24 13:14:39.243642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-2ba6ac69-10f3-46e3-9a5f-d59ace305b10 req-b3d80b76-b101-419d-91aa-f9b1f25daef6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033184 Oct 24 13:14:39.244677 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 139/279] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:14:39.280774 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-20066949-dce4-4e0c-9605-42b2ff9eba8d tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:39.288585 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-20066949-dce4-4e0c-9605-42b2ff9eba8d tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541" status: 200 len: 1313 microversion: 2.1 time: 0.226087 Oct 24 13:14:39.289219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 141/280] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:39 2022] GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:39.293584 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-63a547c1-40b3-4325-bf77-53ae5d181710 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:39.294478 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-63a547c1-40b3-4325-bf77-53ae5d181710 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:39.306096 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-63a547c1-40b3-4325-bf77-53ae5d181710 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:39.306593 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-63a547c1-40b3-4325-bf77-53ae5d181710 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:39.307390 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-63a547c1-40b3-4325-bf77-53ae5d181710 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:39.308104 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-63a547c1-40b3-4325-bf77-53ae5d181710 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:39.309124 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-63a547c1-40b3-4325-bf77-53ae5d181710 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:39.309563 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-63a547c1-40b3-4325-bf77-53ae5d181710 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:39.352748 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-8806e25b-131e-4b20-a6d5-6719c2f47741 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:39.353369 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-8806e25b-131e-4b20-a6d5-6719c2f47741 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:39.361375 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8806e25b-131e-4b20-a6d5-6719c2f47741 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:39.361862 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8806e25b-131e-4b20-a6d5-6719c2f47741 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:39.362297 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8806e25b-131e-4b20-a6d5-6719c2f47741 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:39.362989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8806e25b-131e-4b20-a6d5-6719c2f47741 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:39.363473 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8806e25b-131e-4b20-a6d5-6719c2f47741 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:39.363893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8806e25b-131e-4b20-a6d5-6719c2f47741 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:39.457896 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-63a547c1-40b3-4325-bf77-53ae5d181710 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:39.465984 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-63a547c1-40b3-4325-bf77-53ae5d181710 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1371 microversion: 2.1 time: 0.177109 Oct 24 13:14:39.466556 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 140/281] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:39 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:39.501899 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-8806e25b-131e-4b20-a6d5-6719c2f47741 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:39.509965 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-8806e25b-131e-4b20-a6d5-6719c2f47741 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:39.511762 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-8806e25b-131e-4b20-a6d5-6719c2f47741 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:39.513679 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-8806e25b-131e-4b20-a6d5-6719c2f47741 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1742 microversion: 2.20 time: 0.167503 Oct 24 13:14:39.514440 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 142/282] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:39 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1742 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:14:39.982897 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-217eba87-0bd2-4993-bccc-c5f6c0e82f99 req-b21db5dc-debb-4897-bd40-5e17f7bb676f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24354cc9-2856-455f-b89e-cd913ef97dde", "name": "network-vif-plugged", "status": "completed", "tag": "e9210097-debc-417e-a4c0-33a08dd9bfd8"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:39.993034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-217eba87-0bd2-4993-bccc-c5f6c0e82f99 req-b21db5dc-debb-4897-bd40-5e17f7bb676f service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:39.993517 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-217eba87-0bd2-4993-bccc-c5f6c0e82f99 req-b21db5dc-debb-4897-bd40-5e17f7bb676f service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:39.993974 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-217eba87-0bd2-4993-bccc-c5f6c0e82f99 req-b21db5dc-debb-4897-bd40-5e17f7bb676f service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:40.007624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-217eba87-0bd2-4993-bccc-c5f6c0e82f99 req-b21db5dc-debb-4897-bd40-5e17f7bb676f service nova] Creating event network-vif-plugged:e9210097-debc-417e-a4c0-33a08dd9bfd8 for instance 24354cc9-2856-455f-b89e-cd913ef97dde on hv-cinder-86248 Oct 24 13:14:40.013694 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-217eba87-0bd2-4993-bccc-c5f6c0e82f99 req-b21db5dc-debb-4897-bd40-5e17f7bb676f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035514 Oct 24 13:14:40.014301 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 141/283] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:14:40.034770 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-b1509e40-1591-4009-aeff-b4b0f4cedd65 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:40.035432 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-b1509e40-1591-4009-aeff-b4b0f4cedd65 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:40.041940 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b1509e40-1591-4009-aeff-b4b0f4cedd65 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:40.042428 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b1509e40-1591-4009-aeff-b4b0f4cedd65 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:40.043535 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b1509e40-1591-4009-aeff-b4b0f4cedd65 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:40.044236 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b1509e40-1591-4009-aeff-b4b0f4cedd65 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:40.044701 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b1509e40-1591-4009-aeff-b4b0f4cedd65 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:40.045129 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b1509e40-1591-4009-aeff-b4b0f4cedd65 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:40.054004 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-ea26f613-dbb9-4914-983d-386390f263db tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:40.055030 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-ea26f613-dbb9-4914-983d-386390f263db tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:40.062867 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ea26f613-dbb9-4914-983d-386390f263db tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:40.063714 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ea26f613-dbb9-4914-983d-386390f263db tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:40.064361 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ea26f613-dbb9-4914-983d-386390f263db tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:40.065625 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ea26f613-dbb9-4914-983d-386390f263db tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:40.066622 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ea26f613-dbb9-4914-983d-386390f263db tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:40.067415 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ea26f613-dbb9-4914-983d-386390f263db tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:40.196513 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-b1509e40-1591-4009-aeff-b4b0f4cedd65 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:40.205787 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-b1509e40-1591-4009-aeff-b4b0f4cedd65 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1368 microversion: 2.1 time: 0.175510 Oct 24 13:14:40.220405 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 143/284] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:40 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:40.221882 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-ea26f613-dbb9-4914-983d-386390f263db tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:40.230776 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-ea26f613-dbb9-4914-983d-386390f263db tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1318 microversion: 2.1 time: 0.180294 Oct 24 13:14:40.231677 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 142/285] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:40 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:40.313270 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d6ddfa02-6a95-4b12-af4f-17223dd71493 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:40.313907 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-d6ddfa02-6a95-4b12-af4f-17223dd71493 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:40.319878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d6ddfa02-6a95-4b12-af4f-17223dd71493 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:40.320358 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d6ddfa02-6a95-4b12-af4f-17223dd71493 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:40.320792 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d6ddfa02-6a95-4b12-af4f-17223dd71493 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:40.321472 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d6ddfa02-6a95-4b12-af4f-17223dd71493 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:40.321923 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d6ddfa02-6a95-4b12-af4f-17223dd71493 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:40.322341 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d6ddfa02-6a95-4b12-af4f-17223dd71493 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:40.488381 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-d6ddfa02-6a95-4b12-af4f-17223dd71493 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:40.492131 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-2f89617f-bcf0-4306-99e9-7375e80a3796 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:40.492780 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-2f89617f-bcf0-4306-99e9-7375e80a3796 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:40.499735 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-d6ddfa02-6a95-4b12-af4f-17223dd71493 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541" status: 200 len: 1313 microversion: 2.1 time: 0.190289 Oct 24 13:14:40.515274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2f89617f-bcf0-4306-99e9-7375e80a3796 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:40.515274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2f89617f-bcf0-4306-99e9-7375e80a3796 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:40.515274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2f89617f-bcf0-4306-99e9-7375e80a3796 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:40.515274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2f89617f-bcf0-4306-99e9-7375e80a3796 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:40.515766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2f89617f-bcf0-4306-99e9-7375e80a3796 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:40.515766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2f89617f-bcf0-4306-99e9-7375e80a3796 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:40.518071 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 144/286] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:40 2022] GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:40.547326 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-08a001f5-232b-44db-8b6b-4fefaeb888d2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:40.547947 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-08a001f5-232b-44db-8b6b-4fefaeb888d2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:40.567815 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08a001f5-232b-44db-8b6b-4fefaeb888d2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:40.569551 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08a001f5-232b-44db-8b6b-4fefaeb888d2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:40.570245 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08a001f5-232b-44db-8b6b-4fefaeb888d2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:40.571372 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08a001f5-232b-44db-8b6b-4fefaeb888d2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:40.572043 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08a001f5-232b-44db-8b6b-4fefaeb888d2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:40.572840 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08a001f5-232b-44db-8b6b-4fefaeb888d2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:40.816029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-2f89617f-bcf0-4306-99e9-7375e80a3796 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:40.826785 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-2f89617f-bcf0-4306-99e9-7375e80a3796 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1371 microversion: 2.1 time: 0.340734 Oct 24 13:14:40.827861 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 143/287] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:40 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1371 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:40.862472 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-08a001f5-232b-44db-8b6b-4fefaeb888d2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:40.872197 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-08a001f5-232b-44db-8b6b-4fefaeb888d2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:40.873801 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-08a001f5-232b-44db-8b6b-4fefaeb888d2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:40.875032 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-08a001f5-232b-44db-8b6b-4fefaeb888d2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1742 microversion: 2.20 time: 0.338444 Oct 24 13:14:40.875621 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 145/288] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:40 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1742 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:14:41.231145 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8b37e9f8-690c-4c5c-aeb7-2bf875a1ad9b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:41.231815 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-8b37e9f8-690c-4c5c-aeb7-2bf875a1ad9b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:41.238354 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8b37e9f8-690c-4c5c-aeb7-2bf875a1ad9b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:41.238788 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8b37e9f8-690c-4c5c-aeb7-2bf875a1ad9b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:41.239252 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8b37e9f8-690c-4c5c-aeb7-2bf875a1ad9b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:41.240288 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8b37e9f8-690c-4c5c-aeb7-2bf875a1ad9b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:41.240702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8b37e9f8-690c-4c5c-aeb7-2bf875a1ad9b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:41.241138 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8b37e9f8-690c-4c5c-aeb7-2bf875a1ad9b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:41.253113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-f06a9bed-3cc8-482b-8bf8-b03a7b99abf2 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:41.254416 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-f06a9bed-3cc8-482b-8bf8-b03a7b99abf2 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:41.263357 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f06a9bed-3cc8-482b-8bf8-b03a7b99abf2 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:41.264158 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f06a9bed-3cc8-482b-8bf8-b03a7b99abf2 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:41.264793 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f06a9bed-3cc8-482b-8bf8-b03a7b99abf2 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:41.265887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f06a9bed-3cc8-482b-8bf8-b03a7b99abf2 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:41.266340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f06a9bed-3cc8-482b-8bf8-b03a7b99abf2 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:41.266823 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f06a9bed-3cc8-482b-8bf8-b03a7b99abf2 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:41.377411 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-8b37e9f8-690c-4c5c-aeb7-2bf875a1ad9b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:41.385059 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-8b37e9f8-690c-4c5c-aeb7-2bf875a1ad9b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1368 microversion: 2.1 time: 0.158095 Oct 24 13:14:41.385885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 144/289] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:41 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:41.397687 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-f06a9bed-3cc8-482b-8bf8-b03a7b99abf2 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:41.405639 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-f06a9bed-3cc8-482b-8bf8-b03a7b99abf2 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1318 microversion: 2.1 time: 0.156420 Oct 24 13:14:41.406259 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 146/290] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:41 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:41.528250 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9f4e8bb1-9e6c-4eb9-bb8a-2fb56218ee54 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:41.528854 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9f4e8bb1-9e6c-4eb9-bb8a-2fb56218ee54 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:41.535497 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9f4e8bb1-9e6c-4eb9-bb8a-2fb56218ee54 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:41.535978 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9f4e8bb1-9e6c-4eb9-bb8a-2fb56218ee54 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:41.536408 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9f4e8bb1-9e6c-4eb9-bb8a-2fb56218ee54 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:41.537094 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9f4e8bb1-9e6c-4eb9-bb8a-2fb56218ee54 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:41.537548 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9f4e8bb1-9e6c-4eb9-bb8a-2fb56218ee54 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:41.537976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9f4e8bb1-9e6c-4eb9-bb8a-2fb56218ee54 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:41.663956 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-9f4e8bb1-9e6c-4eb9-bb8a-2fb56218ee54 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:41.672307 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-9f4e8bb1-9e6c-4eb9-bb8a-2fb56218ee54 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541" status: 200 len: 1313 microversion: 2.1 time: 0.147876 Oct 24 13:14:41.672876 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 145/291] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:41 2022] GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:41.852465 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-36108ffc-07c7-421f-81d5-57f1ee007cb0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:41.853095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-36108ffc-07c7-421f-81d5-57f1ee007cb0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:41.859732 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-36108ffc-07c7-421f-81d5-57f1ee007cb0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:41.860214 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-36108ffc-07c7-421f-81d5-57f1ee007cb0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:41.860639 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-36108ffc-07c7-421f-81d5-57f1ee007cb0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:41.861321 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-36108ffc-07c7-421f-81d5-57f1ee007cb0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:41.861762 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-36108ffc-07c7-421f-81d5-57f1ee007cb0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:41.862176 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-36108ffc-07c7-421f-81d5-57f1ee007cb0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:41.900928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-fb8283d6-6293-4566-a8ae-c81a076e985e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:41.901530 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-fb8283d6-6293-4566-a8ae-c81a076e985e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:41.907727 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fb8283d6-6293-4566-a8ae-c81a076e985e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:41.908212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fb8283d6-6293-4566-a8ae-c81a076e985e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:41.908642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fb8283d6-6293-4566-a8ae-c81a076e985e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:41.909337 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fb8283d6-6293-4566-a8ae-c81a076e985e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:41.909781 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fb8283d6-6293-4566-a8ae-c81a076e985e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:41.910200 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fb8283d6-6293-4566-a8ae-c81a076e985e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:41.997461 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=4 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:42.023491 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-36108ffc-07c7-421f-81d5-57f1ee007cb0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:42.033295 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-36108ffc-07c7-421f-81d5-57f1ee007cb0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1371 microversion: 2.1 time: 0.184701 Oct 24 13:14:42.034509 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 147/292] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:41 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:42.053189 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-39220ae6-73a4-4e2d-bbbf-715850e49412 req-ff018564-af0a-4403-9557-c43d00dadf96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b5963f-5199-4822-a8c3-20a8ab09224f", "name": "network-vif-plugged", "status": "completed", "tag": "9241fec5-c702-4043-a917-794ed6ca4105"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:42.065627 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-39220ae6-73a4-4e2d-bbbf-715850e49412 req-ff018564-af0a-4403-9557-c43d00dadf96 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:42.066274 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-39220ae6-73a4-4e2d-bbbf-715850e49412 req-ff018564-af0a-4403-9557-c43d00dadf96 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:42.066851 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-39220ae6-73a4-4e2d-bbbf-715850e49412 req-ff018564-af0a-4403-9557-c43d00dadf96 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:42.079863 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-fb8283d6-6293-4566-a8ae-c81a076e985e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:42.085537 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-39220ae6-73a4-4e2d-bbbf-715850e49412 req-ff018564-af0a-4403-9557-c43d00dadf96 service nova] Creating event network-vif-plugged:9241fec5-c702-4043-a917-794ed6ca4105 for instance 27b5963f-5199-4822-a8c3-20a8ab09224f on hv-cinder-86248 Oct 24 13:14:42.090994 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-fb8283d6-6293-4566-a8ae-c81a076e985e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:42.091691 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-39220ae6-73a4-4e2d-bbbf-715850e49412 req-ff018564-af0a-4403-9557-c43d00dadf96 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044486 Oct 24 13:14:42.092628 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 148/293] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:14:42.093004 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-fb8283d6-6293-4566-a8ae-c81a076e985e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:42.094536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-fb8283d6-6293-4566-a8ae-c81a076e985e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1737 microversion: 2.20 time: 0.197195 Oct 24 13:14:42.095555 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 146/294] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:41 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:14:42.415626 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-42222c6a-9ebc-4055-9050-07f675b6ff58 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:42.416913 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-42222c6a-9ebc-4055-9050-07f675b6ff58 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:42.428460 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-7f57cfe2-5073-4a86-ac63-48fa28a87bc8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:42.429074 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-42222c6a-9ebc-4055-9050-07f675b6ff58 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:42.429193 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-7f57cfe2-5073-4a86-ac63-48fa28a87bc8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:42.430624 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-42222c6a-9ebc-4055-9050-07f675b6ff58 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:42.431302 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-42222c6a-9ebc-4055-9050-07f675b6ff58 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:42.432535 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-42222c6a-9ebc-4055-9050-07f675b6ff58 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:42.435191 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-42222c6a-9ebc-4055-9050-07f675b6ff58 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:42.435357 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-42222c6a-9ebc-4055-9050-07f675b6ff58 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:42.438170 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7f57cfe2-5073-4a86-ac63-48fa28a87bc8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:42.438655 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7f57cfe2-5073-4a86-ac63-48fa28a87bc8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:42.439108 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7f57cfe2-5073-4a86-ac63-48fa28a87bc8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:42.439997 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7f57cfe2-5073-4a86-ac63-48fa28a87bc8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:42.440469 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7f57cfe2-5073-4a86-ac63-48fa28a87bc8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:42.440886 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7f57cfe2-5073-4a86-ac63-48fa28a87bc8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:42.593104 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-7f57cfe2-5073-4a86-ac63-48fa28a87bc8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:42.600708 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-7f57cfe2-5073-4a86-ac63-48fa28a87bc8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1318 microversion: 2.1 time: 0.176062 Oct 24 13:14:42.601274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 147/295] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:42 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:42.604629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-42222c6a-9ebc-4055-9050-07f675b6ff58 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:42.613407 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-42222c6a-9ebc-4055-9050-07f675b6ff58 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1368 microversion: 2.1 time: 0.206807 Oct 24 13:14:42.613957 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 149/296] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:42 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:42.696016 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-046df7b3-6ac4-484f-8910-3a7be6569292 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:42.696639 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-046df7b3-6ac4-484f-8910-3a7be6569292 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:42.698598 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=4 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:42.706340 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-046df7b3-6ac4-484f-8910-3a7be6569292 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:42.706340 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-046df7b3-6ac4-484f-8910-3a7be6569292 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:42.706340 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-046df7b3-6ac4-484f-8910-3a7be6569292 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:42.706340 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-046df7b3-6ac4-484f-8910-3a7be6569292 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:42.706750 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-046df7b3-6ac4-484f-8910-3a7be6569292 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:42.707128 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-046df7b3-6ac4-484f-8910-3a7be6569292 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:42.711382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=22 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:42.995477 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-046df7b3-6ac4-484f-8910-3a7be6569292 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:43.003890 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-046df7b3-6ac4-484f-8910-3a7be6569292 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541" status: 200 len: 1313 microversion: 2.1 time: 0.311729 Oct 24 13:14:43.019253 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 148/297] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:42 2022] GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541 => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:43.058719 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-6eff10cf-40c2-46cb-bfff-8a67567cc5ff tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:43.059583 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-6eff10cf-40c2-46cb-bfff-8a67567cc5ff tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:43.065086 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=18 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:43.067961 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6eff10cf-40c2-46cb-bfff-8a67567cc5ff tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:43.068515 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6eff10cf-40c2-46cb-bfff-8a67567cc5ff tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:43.069151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6eff10cf-40c2-46cb-bfff-8a67567cc5ff tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:43.069861 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6eff10cf-40c2-46cb-bfff-8a67567cc5ff tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:43.070316 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6eff10cf-40c2-46cb-bfff-8a67567cc5ff tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:43.070932 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6eff10cf-40c2-46cb-bfff-8a67567cc5ff tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:43.121537 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-ec8ca94a-f45b-4767-a616-62f5fc64c8af tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:43.122286 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-ec8ca94a-f45b-4767-a616-62f5fc64c8af tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:43.128998 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ec8ca94a-f45b-4767-a616-62f5fc64c8af tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:43.129753 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ec8ca94a-f45b-4767-a616-62f5fc64c8af tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:43.130275 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ec8ca94a-f45b-4767-a616-62f5fc64c8af tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:43.131081 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ec8ca94a-f45b-4767-a616-62f5fc64c8af tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:43.131627 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ec8ca94a-f45b-4767-a616-62f5fc64c8af tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:43.132157 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ec8ca94a-f45b-4767-a616-62f5fc64c8af tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:43.218721 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-6eff10cf-40c2-46cb-bfff-8a67567cc5ff tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:43.226525 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-6eff10cf-40c2-46cb-bfff-8a67567cc5ff tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1371 microversion: 2.1 time: 0.172672 Oct 24 13:14:43.227418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 150/298] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:43 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:43.274956 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-ec8ca94a-f45b-4767-a616-62f5fc64c8af tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:43.283614 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-ec8ca94a-f45b-4767-a616-62f5fc64c8af tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:43.285246 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-ec8ca94a-f45b-4767-a616-62f5fc64c8af tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:43.286577 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-ec8ca94a-f45b-4767-a616-62f5fc64c8af tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1737 microversion: 2.20 time: 0.169622 Oct 24 13:14:43.287150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 149/299] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:43 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:14:43.625045 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-3e03352e-8040-4925-8cd4-18203232dd1f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:43.625659 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-3e03352e-8040-4925-8cd4-18203232dd1f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:43.632679 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3e03352e-8040-4925-8cd4-18203232dd1f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:43.632679 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3e03352e-8040-4925-8cd4-18203232dd1f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:43.632975 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3e03352e-8040-4925-8cd4-18203232dd1f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:43.633853 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3e03352e-8040-4925-8cd4-18203232dd1f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:43.634462 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3e03352e-8040-4925-8cd4-18203232dd1f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:43.635422 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3e03352e-8040-4925-8cd4-18203232dd1f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:43.639891 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-1d712bf0-0f3b-4894-94ce-68e625c44e04 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:43.642691 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-1d712bf0-0f3b-4894-94ce-68e625c44e04 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:43.651784 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d712bf0-0f3b-4894-94ce-68e625c44e04 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:43.652913 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d712bf0-0f3b-4894-94ce-68e625c44e04 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:43.654277 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d712bf0-0f3b-4894-94ce-68e625c44e04 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:43.655253 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d712bf0-0f3b-4894-94ce-68e625c44e04 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:43.655909 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d712bf0-0f3b-4894-94ce-68e625c44e04 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:43.656540 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d712bf0-0f3b-4894-94ce-68e625c44e04 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:43.746601 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=100 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:43.822609 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-3e03352e-8040-4925-8cd4-18203232dd1f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:43.838964 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-3e03352e-8040-4925-8cd4-18203232dd1f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1318 microversion: 2.1 time: 0.217998 Oct 24 13:14:43.841021 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 151/300] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:43 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:44.005125 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-1d712bf0-0f3b-4894-94ce-68e625c44e04 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:44.026726 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-1d712bf0-0f3b-4894-94ce-68e625c44e04 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1368 microversion: 2.1 time: 0.392220 Oct 24 13:14:44.029306 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 150/301] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:43 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1368 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:44.035991 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-04a850e2-f49d-4ed5-935c-c9f5d6817e93 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:44.037085 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-04a850e2-f49d-4ed5-935c-c9f5d6817e93 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:44.045237 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:44.048232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-04a850e2-f49d-4ed5-935c-c9f5d6817e93 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:44.050037 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-04a850e2-f49d-4ed5-935c-c9f5d6817e93 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:44.050685 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-04a850e2-f49d-4ed5-935c-c9f5d6817e93 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:44.051676 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-04a850e2-f49d-4ed5-935c-c9f5d6817e93 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:44.052836 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-04a850e2-f49d-4ed5-935c-c9f5d6817e93 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:44.053471 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-04a850e2-f49d-4ed5-935c-c9f5d6817e93 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:44.240402 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-d7220152-6482-455f-85e8-70f3aa48d800 req-4323b43d-4014-46cf-a3d8-be215f724532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c60f48-8ebd-45ea-880a-c786cf73b541", "name": "network-vif-plugged", "status": "completed", "tag": "71e22cc0-7b16-4e0f-bd74-9915e3a6bc11"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:44.265006 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-04a850e2-f49d-4ed5-935c-c9f5d6817e93 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:44.265562 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-d7220152-6482-455f-85e8-70f3aa48d800 req-4323b43d-4014-46cf-a3d8-be215f724532 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:44.266324 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-d7220152-6482-455f-85e8-70f3aa48d800 req-4323b43d-4014-46cf-a3d8-be215f724532 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:44.271213 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-d7220152-6482-455f-85e8-70f3aa48d800 req-4323b43d-4014-46cf-a3d8-be215f724532 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:44.276003 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-04a850e2-f49d-4ed5-935c-c9f5d6817e93 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541" status: 200 len: 1313 microversion: 2.1 time: 0.251114 Oct 24 13:14:44.290573 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-d7220152-6482-455f-85e8-70f3aa48d800 req-4323b43d-4014-46cf-a3d8-be215f724532 service nova] Creating event network-vif-plugged:71e22cc0-7b16-4e0f-bd74-9915e3a6bc11 for instance 76c60f48-8ebd-45ea-880a-c786cf73b541 on hv-cinder-86248 Oct 24 13:14:44.291736 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 152/302] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:44 2022] GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:44.299259 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-7da3d303-afc7-442a-9fc2-370fd640e735 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:44.300199 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-7da3d303-afc7-442a-9fc2-370fd640e735 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:44.302527 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-d7220152-6482-455f-85e8-70f3aa48d800 req-4323b43d-4014-46cf-a3d8-be215f724532 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066624 Oct 24 13:14:44.303634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 151/303] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:14:44.310715 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7da3d303-afc7-442a-9fc2-370fd640e735 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:44.311706 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7da3d303-afc7-442a-9fc2-370fd640e735 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:44.312367 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7da3d303-afc7-442a-9fc2-370fd640e735 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:44.313328 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7da3d303-afc7-442a-9fc2-370fd640e735 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:44.313938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7da3d303-afc7-442a-9fc2-370fd640e735 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:44.314562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7da3d303-afc7-442a-9fc2-370fd640e735 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:44.330337 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-636a3423-d2b0-454a-843a-e89b0cc1060c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:44.331288 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-636a3423-d2b0-454a-843a-e89b0cc1060c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:44.353066 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-636a3423-d2b0-454a-843a-e89b0cc1060c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:44.353565 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-636a3423-d2b0-454a-843a-e89b0cc1060c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:44.354028 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-636a3423-d2b0-454a-843a-e89b0cc1060c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:44.356319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-636a3423-d2b0-454a-843a-e89b0cc1060c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:44.356909 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-636a3423-d2b0-454a-843a-e89b0cc1060c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:44.357655 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-636a3423-d2b0-454a-843a-e89b0cc1060c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:44.515285 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-7da3d303-afc7-442a-9fc2-370fd640e735 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:44.525942 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-7da3d303-afc7-442a-9fc2-370fd640e735 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1371 microversion: 2.1 time: 0.232813 Oct 24 13:14:44.527507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 153/304] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:44 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:44.658499 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-636a3423-d2b0-454a-843a-e89b0cc1060c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:44.671114 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-636a3423-d2b0-454a-843a-e89b0cc1060c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:44.677257 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-636a3423-d2b0-454a-843a-e89b0cc1060c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:44.679397 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-636a3423-d2b0-454a-843a-e89b0cc1060c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1737 microversion: 2.20 time: 0.368964 Oct 24 13:14:44.680365 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 152/305] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:44 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1737 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:14:44.868210 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-25bfd791-00ed-4458-955f-89b3a4d8f702 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:44.868937 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-25bfd791-00ed-4458-955f-89b3a4d8f702 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:44.875730 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-25bfd791-00ed-4458-955f-89b3a4d8f702 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:44.876434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-25bfd791-00ed-4458-955f-89b3a4d8f702 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:44.877048 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-25bfd791-00ed-4458-955f-89b3a4d8f702 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:44.877894 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-25bfd791-00ed-4458-955f-89b3a4d8f702 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:44.878498 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-25bfd791-00ed-4458-955f-89b3a4d8f702 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:44.879101 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-25bfd791-00ed-4458-955f-89b3a4d8f702 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:45.018852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-25bfd791-00ed-4458-955f-89b3a4d8f702 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:45.028098 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-25bfd791-00ed-4458-955f-89b3a4d8f702 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1507 microversion: 2.1 time: 0.163714 Oct 24 13:14:45.028978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 154/306] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:44 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:45.050660 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-474f8051-0a74-44f8-88c0-d1d9fd002247 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:45.051321 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-474f8051-0a74-44f8-88c0-d1d9fd002247 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:45.057873 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-474f8051-0a74-44f8-88c0-d1d9fd002247 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:45.058735 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-474f8051-0a74-44f8-88c0-d1d9fd002247 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:45.059553 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-474f8051-0a74-44f8-88c0-d1d9fd002247 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:45.060734 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-474f8051-0a74-44f8-88c0-d1d9fd002247 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:45.061437 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-474f8051-0a74-44f8-88c0-d1d9fd002247 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:45.062134 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-474f8051-0a74-44f8-88c0-d1d9fd002247 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:45.288810 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-474f8051-0a74-44f8-88c0-d1d9fd002247 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:45.300674 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-474f8051-0a74-44f8-88c0-d1d9fd002247 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1368 microversion: 2.1 time: 0.254615 Oct 24 13:14:45.303585 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 153/307] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:45 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1368 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:45.306336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-42805ca8-8f8f-4f90-b97e-43ed48ccedf1 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:45.307205 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-42805ca8-8f8f-4f90-b97e-43ed48ccedf1 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:45.315540 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-42805ca8-8f8f-4f90-b97e-43ed48ccedf1 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:45.316409 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-42805ca8-8f8f-4f90-b97e-43ed48ccedf1 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:45.317082 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-42805ca8-8f8f-4f90-b97e-43ed48ccedf1 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:45.318278 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-42805ca8-8f8f-4f90-b97e-43ed48ccedf1 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:45.319281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-42805ca8-8f8f-4f90-b97e-43ed48ccedf1 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:45.320146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-42805ca8-8f8f-4f90-b97e-43ed48ccedf1 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:45.496347 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-42805ca8-8f8f-4f90-b97e-43ed48ccedf1 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:45.507074 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-42805ca8-8f8f-4f90-b97e-43ed48ccedf1 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541" status: 200 len: 1313 microversion: 2.1 time: 0.207338 Oct 24 13:14:45.508309 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 155/308] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:45 2022] GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:45.554460 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-1114d91b-f45f-4907-9b11-7840d9121374 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:45.555993 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-1114d91b-f45f-4907-9b11-7840d9121374 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:45.565377 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1114d91b-f45f-4907-9b11-7840d9121374 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:45.565920 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1114d91b-f45f-4907-9b11-7840d9121374 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:45.566768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1114d91b-f45f-4907-9b11-7840d9121374 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:45.568376 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1114d91b-f45f-4907-9b11-7840d9121374 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:45.569646 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1114d91b-f45f-4907-9b11-7840d9121374 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:45.570536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1114d91b-f45f-4907-9b11-7840d9121374 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:45.715439 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-4287df2e-7525-4ed0-a103-7be534141f60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:45.716059 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-4287df2e-7525-4ed0-a103-7be534141f60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:45.722581 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4287df2e-7525-4ed0-a103-7be534141f60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:45.723362 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4287df2e-7525-4ed0-a103-7be534141f60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:45.724016 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4287df2e-7525-4ed0-a103-7be534141f60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:45.724928 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4287df2e-7525-4ed0-a103-7be534141f60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:45.725571 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4287df2e-7525-4ed0-a103-7be534141f60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:45.726228 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4287df2e-7525-4ed0-a103-7be534141f60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:45.735087 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-1114d91b-f45f-4907-9b11-7840d9121374 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:45.739098 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=100 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:45.746339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-1114d91b-f45f-4907-9b11-7840d9121374 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1371 microversion: 2.1 time: 0.199395 Oct 24 13:14:45.747775 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 154/309] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:45 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:45.928282 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-4287df2e-7525-4ed0-a103-7be534141f60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:45.940759 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-4287df2e-7525-4ed0-a103-7be534141f60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:45.942631 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-4287df2e-7525-4ed0-a103-7be534141f60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:45.944039 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-4287df2e-7525-4ed0-a103-7be534141f60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1737 microversion: 2.20 time: 0.232747 Oct 24 13:14:45.945031 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 156/310] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:45 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1737 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:14:46.325563 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-83b1f199-a7a7-4d54-aa32-eb024e2d4fea tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:46.326472 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-83b1f199-a7a7-4d54-aa32-eb024e2d4fea tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:46.333840 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-83b1f199-a7a7-4d54-aa32-eb024e2d4fea tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:46.334692 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-83b1f199-a7a7-4d54-aa32-eb024e2d4fea tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:46.335504 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-83b1f199-a7a7-4d54-aa32-eb024e2d4fea tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:46.336339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-83b1f199-a7a7-4d54-aa32-eb024e2d4fea tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:46.337025 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-83b1f199-a7a7-4d54-aa32-eb024e2d4fea tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:46.337643 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-83b1f199-a7a7-4d54-aa32-eb024e2d4fea tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:46.360528 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-29b7206d-6ec6-46a5-b46c-e26f7d25826e req-ae37d597-8c3b-42f0-a145-65532534e2be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bd238e2-4223-465c-8028-c291fe1db874", "name": "network-vif-plugged", "status": "completed", "tag": "b1289f23-07a5-45c6-9004-035914303827"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:46.376237 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-29b7206d-6ec6-46a5-b46c-e26f7d25826e req-ae37d597-8c3b-42f0-a145-65532534e2be service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:46.377083 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-29b7206d-6ec6-46a5-b46c-e26f7d25826e req-ae37d597-8c3b-42f0-a145-65532534e2be service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:46.377723 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-29b7206d-6ec6-46a5-b46c-e26f7d25826e req-ae37d597-8c3b-42f0-a145-65532534e2be service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:46.392084 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-29b7206d-6ec6-46a5-b46c-e26f7d25826e req-ae37d597-8c3b-42f0-a145-65532534e2be service nova] Creating event network-vif-plugged:b1289f23-07a5-45c6-9004-035914303827 for instance 6bd238e2-4223-465c-8028-c291fe1db874 on hv-cinder-86248 Oct 24 13:14:46.397494 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-29b7206d-6ec6-46a5-b46c-e26f7d25826e req-ae37d597-8c3b-42f0-a145-65532534e2be service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040838 Oct 24 13:14:46.398173 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 157/311] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:14:46.503491 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-83b1f199-a7a7-4d54-aa32-eb024e2d4fea tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:46.515486 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-83b1f199-a7a7-4d54-aa32-eb024e2d4fea tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1368 microversion: 2.1 time: 0.194362 Oct 24 13:14:46.516686 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 155/312] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:46 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:46.534549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-f7a03c53-a86a-4e1d-891b-82a275ec1f7c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:46.535282 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-f7a03c53-a86a-4e1d-891b-82a275ec1f7c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:46.548226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f7a03c53-a86a-4e1d-891b-82a275ec1f7c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:46.549103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f7a03c53-a86a-4e1d-891b-82a275ec1f7c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:46.549676 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f7a03c53-a86a-4e1d-891b-82a275ec1f7c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:46.550707 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f7a03c53-a86a-4e1d-891b-82a275ec1f7c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:46.551334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f7a03c53-a86a-4e1d-891b-82a275ec1f7c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:46.551886 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f7a03c53-a86a-4e1d-891b-82a275ec1f7c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:46.731999 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-f7a03c53-a86a-4e1d-891b-82a275ec1f7c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:46.744726 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-f7a03c53-a86a-4e1d-891b-82a275ec1f7c tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541" status: 200 len: 1313 microversion: 2.1 time: 0.214389 Oct 24 13:14:46.746201 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 158/313] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:46 2022] GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:46.775483 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-1e28cffb-3a73-4ebf-afd6-cc32ea764b1c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:46.778501 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-1e28cffb-3a73-4ebf-afd6-cc32ea764b1c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:46.781892 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:46.803346 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1e28cffb-3a73-4ebf-afd6-cc32ea764b1c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:46.806697 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1e28cffb-3a73-4ebf-afd6-cc32ea764b1c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:46.807172 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1e28cffb-3a73-4ebf-afd6-cc32ea764b1c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:46.807924 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1e28cffb-3a73-4ebf-afd6-cc32ea764b1c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:46.810308 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1e28cffb-3a73-4ebf-afd6-cc32ea764b1c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:46.810754 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1e28cffb-3a73-4ebf-afd6-cc32ea764b1c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:46.972317 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-fcf9a0fb-50bc-47f4-9648-81a378758ee8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:46.981444 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-fcf9a0fb-50bc-47f4-9648-81a378758ee8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:46.993641 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fcf9a0fb-50bc-47f4-9648-81a378758ee8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:46.994130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fcf9a0fb-50bc-47f4-9648-81a378758ee8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:46.994562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fcf9a0fb-50bc-47f4-9648-81a378758ee8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:46.995316 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fcf9a0fb-50bc-47f4-9648-81a378758ee8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:46.995853 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fcf9a0fb-50bc-47f4-9648-81a378758ee8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:46.996312 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fcf9a0fb-50bc-47f4-9648-81a378758ee8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:47.050674 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-1e28cffb-3a73-4ebf-afd6-cc32ea764b1c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:47.059844 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-1e28cffb-3a73-4ebf-afd6-cc32ea764b1c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1371 microversion: 2.1 time: 0.290342 Oct 24 13:14:47.060679 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 156/314] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:46 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1371 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:47.171617 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-fcf9a0fb-50bc-47f4-9648-81a378758ee8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:47.180903 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-fcf9a0fb-50bc-47f4-9648-81a378758ee8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:47.188949 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-fcf9a0fb-50bc-47f4-9648-81a378758ee8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:47.190375 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-fcf9a0fb-50bc-47f4-9648-81a378758ee8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1737 microversion: 2.20 time: 0.222204 Oct 24 13:14:47.202329 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 159/315] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:46 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:14:47.540561 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-23c99d11-6257-4341-b2ff-e1b4320db5e5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:47.541520 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-23c99d11-6257-4341-b2ff-e1b4320db5e5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:47.548184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-23c99d11-6257-4341-b2ff-e1b4320db5e5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:47.548822 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-23c99d11-6257-4341-b2ff-e1b4320db5e5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:47.549505 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-23c99d11-6257-4341-b2ff-e1b4320db5e5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:47.550295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-23c99d11-6257-4341-b2ff-e1b4320db5e5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:47.550947 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-23c99d11-6257-4341-b2ff-e1b4320db5e5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:47.553097 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-23c99d11-6257-4341-b2ff-e1b4320db5e5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:47.713754 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-23c99d11-6257-4341-b2ff-e1b4320db5e5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:47.724083 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-23c99d11-6257-4341-b2ff-e1b4320db5e5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1368 microversion: 2.1 time: 0.187245 Oct 24 13:14:47.724886 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 157/316] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:47 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:47.771497 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-290179ee-0f3f-4715-aa28-85dbaed58e48 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:47.772645 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-290179ee-0f3f-4715-aa28-85dbaed58e48 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:47.780085 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-290179ee-0f3f-4715-aa28-85dbaed58e48 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:47.780613 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-290179ee-0f3f-4715-aa28-85dbaed58e48 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:47.783600 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-290179ee-0f3f-4715-aa28-85dbaed58e48 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:47.783600 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-290179ee-0f3f-4715-aa28-85dbaed58e48 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:47.783600 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-290179ee-0f3f-4715-aa28-85dbaed58e48 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:47.783600 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-290179ee-0f3f-4715-aa28-85dbaed58e48 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:47.946471 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-290179ee-0f3f-4715-aa28-85dbaed58e48 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:47.955200 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-290179ee-0f3f-4715-aa28-85dbaed58e48 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541" status: 200 len: 1497 microversion: 2.1 time: 0.187568 Oct 24 13:14:47.956145 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 160/317] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:47 2022] GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541 => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:47.988281 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8efe803c-5089-4dc0-b312-af795829a1e2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:47.988887 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-8efe803c-5089-4dc0-b312-af795829a1e2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:48.000710 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8efe803c-5089-4dc0-b312-af795829a1e2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:48.003113 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8efe803c-5089-4dc0-b312-af795829a1e2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:48.003825 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8efe803c-5089-4dc0-b312-af795829a1e2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:48.004735 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8efe803c-5089-4dc0-b312-af795829a1e2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:48.006466 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8efe803c-5089-4dc0-b312-af795829a1e2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:48.006903 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8efe803c-5089-4dc0-b312-af795829a1e2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:48.046574 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-8efe803c-5089-4dc0-b312-af795829a1e2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf/ips" status: 200 len: 146 microversion: 2.1 time: 0.062011 Oct 24 13:14:48.047347 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 158/318] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Oct 24 13:14:47 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf/ips => generated 146 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:14:48.087236 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-8cfc6a5a-8a13-4e3c-997b-bf30fa92f351 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:48.088833 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-8cfc6a5a-8a13-4e3c-997b-bf30fa92f351 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:48.097884 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8cfc6a5a-8a13-4e3c-997b-bf30fa92f351 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:48.098378 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8cfc6a5a-8a13-4e3c-997b-bf30fa92f351 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:48.098816 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8cfc6a5a-8a13-4e3c-997b-bf30fa92f351 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:48.099571 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8cfc6a5a-8a13-4e3c-997b-bf30fa92f351 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:48.100034 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8cfc6a5a-8a13-4e3c-997b-bf30fa92f351 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:48.100596 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8cfc6a5a-8a13-4e3c-997b-bf30fa92f351 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:48.218104 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-97955dbf-0997-4cae-954b-61402dee5c02 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:48.218861 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-97955dbf-0997-4cae-954b-61402dee5c02 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:48.232484 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-97955dbf-0997-4cae-954b-61402dee5c02 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:48.239555 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-97955dbf-0997-4cae-954b-61402dee5c02 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:48.240300 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-97955dbf-0997-4cae-954b-61402dee5c02 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:48.245138 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-97955dbf-0997-4cae-954b-61402dee5c02 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:48.247460 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-97955dbf-0997-4cae-954b-61402dee5c02 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:48.248434 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-97955dbf-0997-4cae-954b-61402dee5c02 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:48.322538 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-8cfc6a5a-8a13-4e3c-997b-bf30fa92f351 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:48.361229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-8cfc6a5a-8a13-4e3c-997b-bf30fa92f351 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1371 microversion: 2.1 time: 0.280204 Oct 24 13:14:48.379215 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 161/319] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:48 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1371 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:48.468538 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-7d2d1b8e-5fdd-4480-b2c4-2092ad6bbccd req-42578113-9ef3-49da-955c-de7c57003254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc138711-ddfb-4b61-bf88-532641a857cd", "name": "network-vif-plugged", "status": "completed", "tag": "37f90190-526c-4317-90a1-c6197bdf36c1"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:48.501357 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-7d2d1b8e-5fdd-4480-b2c4-2092ad6bbccd req-42578113-9ef3-49da-955c-de7c57003254 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:48.501739 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-7d2d1b8e-5fdd-4480-b2c4-2092ad6bbccd req-42578113-9ef3-49da-955c-de7c57003254 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:48.505942 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-7d2d1b8e-5fdd-4480-b2c4-2092ad6bbccd req-42578113-9ef3-49da-955c-de7c57003254 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:48.532469 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-97955dbf-0997-4cae-954b-61402dee5c02 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:48.546140 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-97955dbf-0997-4cae-954b-61402dee5c02 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:48.547038 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-7d2d1b8e-5fdd-4480-b2c4-2092ad6bbccd req-42578113-9ef3-49da-955c-de7c57003254 service nova] Creating event network-vif-plugged:37f90190-526c-4317-90a1-c6197bdf36c1 for instance dc138711-ddfb-4b61-bf88-532641a857cd on hv-cinder-86248 Oct 24 13:14:48.548785 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-97955dbf-0997-4cae-954b-61402dee5c02 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:48.550213 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-97955dbf-0997-4cae-954b-61402dee5c02 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1737 microversion: 2.20 time: 0.337823 Oct 24 13:14:48.551350 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 159/320] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:48 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1737 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:14:48.553392 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-7d2d1b8e-5fdd-4480-b2c4-2092ad6bbccd req-42578113-9ef3-49da-955c-de7c57003254 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089744 Oct 24 13:14:48.554382 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 162/321] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:14:48.748108 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9edeb21d-11f3-4eea-9d57-9659cba76cb6 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:48.748736 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9edeb21d-11f3-4eea-9d57-9659cba76cb6 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:48.756616 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9edeb21d-11f3-4eea-9d57-9659cba76cb6 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:48.757841 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9edeb21d-11f3-4eea-9d57-9659cba76cb6 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:48.758274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9edeb21d-11f3-4eea-9d57-9659cba76cb6 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:48.758967 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9edeb21d-11f3-4eea-9d57-9659cba76cb6 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:48.759459 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9edeb21d-11f3-4eea-9d57-9659cba76cb6 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:48.760496 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9edeb21d-11f3-4eea-9d57-9659cba76cb6 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:48.775841 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-1102ac63-6a73-459c-ab92-1c0911debe2b tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:48.776418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-1102ac63-6a73-459c-ab92-1c0911debe2b tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:48.787857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1102ac63-6a73-459c-ab92-1c0911debe2b tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:48.788614 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1102ac63-6a73-459c-ab92-1c0911debe2b tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:48.794770 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1102ac63-6a73-459c-ab92-1c0911debe2b tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:48.795931 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1102ac63-6a73-459c-ab92-1c0911debe2b tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:48.796545 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1102ac63-6a73-459c-ab92-1c0911debe2b tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:48.801310 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1102ac63-6a73-459c-ab92-1c0911debe2b tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:48.865737 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-1102ac63-6a73-459c-ab92-1c0911debe2b tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] Going to try to terminate instance {{(pid=118914) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:14:48.982183 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-1102ac63-6a73-459c-ab92-1c0911debe2b tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "DELETE /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541" status: 204 len: 0 microversion: 2.1 time: 0.211304 Oct 24 13:14:48.982986 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 163/322] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:14:48 2022] DELETE /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:14:48.994750 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-acd56bdf-67b0-4dda-b560-77e644ae821b tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:48.996255 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-acd56bdf-67b0-4dda-b560-77e644ae821b tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:49.002674 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-acd56bdf-67b0-4dda-b560-77e644ae821b tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:49.003200 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-acd56bdf-67b0-4dda-b560-77e644ae821b tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:49.003640 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-acd56bdf-67b0-4dda-b560-77e644ae821b tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:49.004357 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-acd56bdf-67b0-4dda-b560-77e644ae821b tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:49.004812 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-acd56bdf-67b0-4dda-b560-77e644ae821b tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:49.005232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-acd56bdf-67b0-4dda-b560-77e644ae821b tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:49.179267 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-acd56bdf-67b0-4dda-b560-77e644ae821b tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:49.188201 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-acd56bdf-67b0-4dda-b560-77e644ae821b tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541" status: 200 len: 1503 microversion: 2.1 time: 0.200202 Oct 24 13:14:49.203671 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 164/323] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:48 2022] GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541 => generated 1503 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:49.223849 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-9edeb21d-11f3-4eea-9d57-9659cba76cb6 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:49.239948 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-9edeb21d-11f3-4eea-9d57-9659cba76cb6 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1368 microversion: 2.1 time: 0.496185 Oct 24 13:14:49.240583 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 160/324] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:48 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1368 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:49.397767 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-e22441af-f3a5-4b47-b812-8a7d2845dee8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:49.398272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-e22441af-f3a5-4b47-b812-8a7d2845dee8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:49.405295 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e22441af-f3a5-4b47-b812-8a7d2845dee8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:49.406015 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e22441af-f3a5-4b47-b812-8a7d2845dee8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:49.406474 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e22441af-f3a5-4b47-b812-8a7d2845dee8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:49.407197 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e22441af-f3a5-4b47-b812-8a7d2845dee8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:49.407676 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e22441af-f3a5-4b47-b812-8a7d2845dee8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:49.408282 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e22441af-f3a5-4b47-b812-8a7d2845dee8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:49.580997 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-1e91670b-929a-4514-9c75-0244db053f46 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:49.587706 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-1e91670b-929a-4514-9c75-0244db053f46 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:49.609717 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1e91670b-929a-4514-9c75-0244db053f46 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:49.610220 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1e91670b-929a-4514-9c75-0244db053f46 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:49.610892 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1e91670b-929a-4514-9c75-0244db053f46 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:49.611675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1e91670b-929a-4514-9c75-0244db053f46 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:49.612134 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1e91670b-929a-4514-9c75-0244db053f46 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:49.612562 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1e91670b-929a-4514-9c75-0244db053f46 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:49.700809 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-e22441af-f3a5-4b47-b812-8a7d2845dee8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:49.713485 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-e22441af-f3a5-4b47-b812-8a7d2845dee8 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1371 microversion: 2.1 time: 0.320184 Oct 24 13:14:49.714095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 165/325] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:49 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1371 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:49.831911 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-1e91670b-929a-4514-9c75-0244db053f46 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:49.852665 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-1e91670b-929a-4514-9c75-0244db053f46 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:49.854117 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-1e91670b-929a-4514-9c75-0244db053f46 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:49.855878 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-1e91670b-929a-4514-9c75-0244db053f46 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1737 microversion: 2.20 time: 0.282969 Oct 24 13:14:49.867113 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 161/326] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:49 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1737 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:14:50.215434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-40b12ceb-654c-48e1-90cd-f5ecb22b8c4a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:50.216389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-40b12ceb-654c-48e1-90cd-f5ecb22b8c4a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:50.222951 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40b12ceb-654c-48e1-90cd-f5ecb22b8c4a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:50.223556 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40b12ceb-654c-48e1-90cd-f5ecb22b8c4a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:50.224061 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40b12ceb-654c-48e1-90cd-f5ecb22b8c4a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:50.224876 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40b12ceb-654c-48e1-90cd-f5ecb22b8c4a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:50.225337 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40b12ceb-654c-48e1-90cd-f5ecb22b8c4a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:50.225789 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40b12ceb-654c-48e1-90cd-f5ecb22b8c4a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:50.276474 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-7bb3fdc1-13f7-44c3-81b3-625fa2dbdc0e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:50.277970 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-7bb3fdc1-13f7-44c3-81b3-625fa2dbdc0e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:50.289877 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7bb3fdc1-13f7-44c3-81b3-625fa2dbdc0e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:50.290792 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7bb3fdc1-13f7-44c3-81b3-625fa2dbdc0e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:50.291312 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7bb3fdc1-13f7-44c3-81b3-625fa2dbdc0e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:50.292167 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7bb3fdc1-13f7-44c3-81b3-625fa2dbdc0e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:50.292632 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7bb3fdc1-13f7-44c3-81b3-625fa2dbdc0e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:50.293620 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7bb3fdc1-13f7-44c3-81b3-625fa2dbdc0e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:50.435847 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-40b12ceb-654c-48e1-90cd-f5ecb22b8c4a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:50.453789 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-40b12ceb-654c-48e1-90cd-f5ecb22b8c4a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541" status: 200 len: 1503 microversion: 2.1 time: 0.243998 Oct 24 13:14:50.454709 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 166/327] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:50 2022] GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541 => generated 1503 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:50.503688 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-7bb3fdc1-13f7-44c3-81b3-625fa2dbdc0e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:50.512845 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-7bb3fdc1-13f7-44c3-81b3-625fa2dbdc0e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1368 microversion: 2.1 time: 0.242383 Oct 24 13:14:50.527258 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 162/328] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:50 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1368 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:50.739602 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-7dcddfdd-d526-47e7-8542-a81a976e279d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:50.740113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-7dcddfdd-d526-47e7-8542-a81a976e279d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:50.747251 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7dcddfdd-d526-47e7-8542-a81a976e279d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:50.747738 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7dcddfdd-d526-47e7-8542-a81a976e279d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:50.748172 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7dcddfdd-d526-47e7-8542-a81a976e279d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:50.748897 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7dcddfdd-d526-47e7-8542-a81a976e279d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:50.749356 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7dcddfdd-d526-47e7-8542-a81a976e279d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:50.749821 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7dcddfdd-d526-47e7-8542-a81a976e279d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:50.887123 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-5cbb70c6-0fc4-4fed-bd4c-c3c5d7e87ffe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:50.888512 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-5cbb70c6-0fc4-4fed-bd4c-c3c5d7e87ffe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:50.895014 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5cbb70c6-0fc4-4fed-bd4c-c3c5d7e87ffe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:50.895847 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5cbb70c6-0fc4-4fed-bd4c-c3c5d7e87ffe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:50.896500 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5cbb70c6-0fc4-4fed-bd4c-c3c5d7e87ffe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:50.897412 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5cbb70c6-0fc4-4fed-bd4c-c3c5d7e87ffe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:50.898215 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5cbb70c6-0fc4-4fed-bd4c-c3c5d7e87ffe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:50.898628 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-7dcddfdd-d526-47e7-8542-a81a976e279d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:50.899347 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5cbb70c6-0fc4-4fed-bd4c-c3c5d7e87ffe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:50.914008 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-7dcddfdd-d526-47e7-8542-a81a976e279d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1565 microversion: 2.1 time: 0.178697 Oct 24 13:14:50.927081 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 167/329] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:50 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:50.940656 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-e6a20cd4-4c18-4224-ba4b-a4d1c2a8fe32 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:50.941241 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-e6a20cd4-4c18-4224-ba4b-a4d1c2a8fe32 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:50.952150 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e6a20cd4-4c18-4224-ba4b-a4d1c2a8fe32 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:50.952669 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e6a20cd4-4c18-4224-ba4b-a4d1c2a8fe32 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:50.953088 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e6a20cd4-4c18-4224-ba4b-a4d1c2a8fe32 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:50.953803 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e6a20cd4-4c18-4224-ba4b-a4d1c2a8fe32 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:50.954262 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e6a20cd4-4c18-4224-ba4b-a4d1c2a8fe32 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:50.954683 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e6a20cd4-4c18-4224-ba4b-a4d1c2a8fe32 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:51.046654 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-e6a20cd4-4c18-4224-ba4b-a4d1c2a8fe32 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111948 Oct 24 13:14:51.047495 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 168/330] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Oct 24 13:14:50 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:14:51.083595 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-5cbb70c6-0fc4-4fed-bd4c-c3c5d7e87ffe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:51.097957 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-5cbb70c6-0fc4-4fed-bd4c-c3c5d7e87ffe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:51.099511 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-5cbb70c6-0fc4-4fed-bd4c-c3c5d7e87ffe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:51.100674 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-5cbb70c6-0fc4-4fed-bd4c-c3c5d7e87ffe tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1737 microversion: 2.20 time: 0.218266 Oct 24 13:14:51.101224 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 163/331] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:50 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:14:51.478283 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-2e15c727-8d6f-46d2-b9d3-60417f94332a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:51.479249 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-2e15c727-8d6f-46d2-b9d3-60417f94332a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:51.485953 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2e15c727-8d6f-46d2-b9d3-60417f94332a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:51.486816 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2e15c727-8d6f-46d2-b9d3-60417f94332a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:51.487536 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2e15c727-8d6f-46d2-b9d3-60417f94332a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:51.488464 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2e15c727-8d6f-46d2-b9d3-60417f94332a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:51.489335 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2e15c727-8d6f-46d2-b9d3-60417f94332a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:51.489980 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2e15c727-8d6f-46d2-b9d3-60417f94332a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:51.536379 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-fd58f909-b9c7-4a4b-89db-77b192ed1254 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:51.536993 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-fd58f909-b9c7-4a4b-89db-77b192ed1254 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:51.549192 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fd58f909-b9c7-4a4b-89db-77b192ed1254 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:51.550006 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fd58f909-b9c7-4a4b-89db-77b192ed1254 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:51.550640 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fd58f909-b9c7-4a4b-89db-77b192ed1254 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:51.551547 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fd58f909-b9c7-4a4b-89db-77b192ed1254 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:51.552220 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fd58f909-b9c7-4a4b-89db-77b192ed1254 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:51.552871 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fd58f909-b9c7-4a4b-89db-77b192ed1254 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:51.746595 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-fd58f909-b9c7-4a4b-89db-77b192ed1254 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:51.760728 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-fd58f909-b9c7-4a4b-89db-77b192ed1254 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1368 microversion: 2.1 time: 0.227629 Oct 24 13:14:51.780036 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 164/332] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:51 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:51.787366 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-0a9b7832-bbf2-4d11-ba6d-d7fc552d0870 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38f7dd8f-43f4-4a40-a488-a5d0661b891b"}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:51.790918 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-0a9b7832-bbf2-4d11-ba6d-d7fc552d0870 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:51.800406 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a9b7832-bbf2-4d11-ba6d-d7fc552d0870 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:51.801225 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a9b7832-bbf2-4d11-ba6d-d7fc552d0870 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:51.804736 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a9b7832-bbf2-4d11-ba6d-d7fc552d0870 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:51.805894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a9b7832-bbf2-4d11-ba6d-d7fc552d0870 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:51.806540 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a9b7832-bbf2-4d11-ba6d-d7fc552d0870 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:51.806976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a9b7832-bbf2-4d11-ba6d-d7fc552d0870 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:51.852805 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-2e15c727-8d6f-46d2-b9d3-60417f94332a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:51.861567 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-2e15c727-8d6f-46d2-b9d3-60417f94332a tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541" status: 200 len: 1503 microversion: 2.1 time: 0.387481 Oct 24 13:14:51.862700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 169/333] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:51 2022] GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541 => generated 1503 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:52.138535 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-5cb2ef24-33f7-4a7a-8842-c3d9d71c10eb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:52.138896 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-5cb2ef24-33f7-4a7a-8842-c3d9d71c10eb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:52.152119 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5cb2ef24-33f7-4a7a-8842-c3d9d71c10eb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:52.155290 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5cb2ef24-33f7-4a7a-8842-c3d9d71c10eb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:52.155782 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5cb2ef24-33f7-4a7a-8842-c3d9d71c10eb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:52.156510 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5cb2ef24-33f7-4a7a-8842-c3d9d71c10eb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:52.156971 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5cb2ef24-33f7-4a7a-8842-c3d9d71c10eb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:52.157394 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5cb2ef24-33f7-4a7a-8842-c3d9d71c10eb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:52.433125 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-5cb2ef24-33f7-4a7a-8842-c3d9d71c10eb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:52.447546 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-5cb2ef24-33f7-4a7a-8842-c3d9d71c10eb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:52.449811 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-5cb2ef24-33f7-4a7a-8842-c3d9d71c10eb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:52.450979 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-5cb2ef24-33f7-4a7a-8842-c3d9d71c10eb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1737 microversion: 2.20 time: 0.317388 Oct 24 13:14:52.451903 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 170/334] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:52 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1737 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:14:52.563859 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-b7cf7a0d-c611-4a60-9d8f-9506cc92c616 req-230eddb4-de4a-42d9-9c3f-da7000793c46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bd238e2-4223-465c-8028-c291fe1db874", "tag": "b1289f23-07a5-45c6-9004-035914303827"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:52.580669 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-b7cf7a0d-c611-4a60-9d8f-9506cc92c616 req-230eddb4-de4a-42d9-9c3f-da7000793c46 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:52.581144 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-b7cf7a0d-c611-4a60-9d8f-9506cc92c616 req-230eddb4-de4a-42d9-9c3f-da7000793c46 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:52.581562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-b7cf7a0d-c611-4a60-9d8f-9506cc92c616 req-230eddb4-de4a-42d9-9c3f-da7000793c46 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:52.604261 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-b7cf7a0d-c611-4a60-9d8f-9506cc92c616 req-230eddb4-de4a-42d9-9c3f-da7000793c46 service nova] Creating event network-changed:b1289f23-07a5-45c6-9004-035914303827 for instance 6bd238e2-4223-465c-8028-c291fe1db874 on hv-cinder-86248 Oct 24 13:14:52.611320 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-b7cf7a0d-c611-4a60-9d8f-9506cc92c616 req-230eddb4-de4a-42d9-9c3f-da7000793c46 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057121 Oct 24 13:14:52.613338 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 171/335] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 24 13:14:52.719757 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-0a9b7832-bbf2-4d11-ba6d-d7fc552d0870 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "POST /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.937249 Oct 24 13:14:52.742139 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 165/336] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 24 13:14:51 2022] POST /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf/os-volume_attachments => generated 194 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:14:52.791640 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-aeafa4c4-e4f5-416c-a340-68680b155c81 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:52.792494 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-aeafa4c4-e4f5-416c-a340-68680b155c81 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:52.817225 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-aeafa4c4-e4f5-416c-a340-68680b155c81 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:52.817638 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-aeafa4c4-e4f5-416c-a340-68680b155c81 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:52.818073 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-aeafa4c4-e4f5-416c-a340-68680b155c81 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:52.818803 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-aeafa4c4-e4f5-416c-a340-68680b155c81 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:52.819286 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-aeafa4c4-e4f5-416c-a340-68680b155c81 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:52.819711 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-aeafa4c4-e4f5-416c-a340-68680b155c81 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:52.894856 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8f111d25-2ebc-49f3-acc8-d8ca9bb19857 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:52.897124 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-8f111d25-2ebc-49f3-acc8-d8ca9bb19857 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:52.910751 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8f111d25-2ebc-49f3-acc8-d8ca9bb19857 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:52.911319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8f111d25-2ebc-49f3-acc8-d8ca9bb19857 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:52.911768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8f111d25-2ebc-49f3-acc8-d8ca9bb19857 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:52.913096 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8f111d25-2ebc-49f3-acc8-d8ca9bb19857 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:52.913555 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8f111d25-2ebc-49f3-acc8-d8ca9bb19857 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:52.913985 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8f111d25-2ebc-49f3-acc8-d8ca9bb19857 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:53.024528 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-aeafa4c4-e4f5-416c-a340-68680b155c81 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:53.033130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-aeafa4c4-e4f5-416c-a340-68680b155c81 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1368 microversion: 2.1 time: 0.245649 Oct 24 13:14:53.043125 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 172/337] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:52 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1368 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:53.146610 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-8f111d25-2ebc-49f3-acc8-d8ca9bb19857 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:53.149690 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:53.158139 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-8f111d25-2ebc-49f3-acc8-d8ca9bb19857 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541" status: 200 len: 1503 microversion: 2.1 time: 0.273048 Oct 24 13:14:53.159176 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 166/338] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:52 2022] GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541 => generated 1503 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:14:53.484147 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-f396d0ab-39b3-49c8-87de-cb34c3cac5d1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:53.497378 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-f396d0ab-39b3-49c8-87de-cb34c3cac5d1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:53.529411 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f396d0ab-39b3-49c8-87de-cb34c3cac5d1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:53.530159 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f396d0ab-39b3-49c8-87de-cb34c3cac5d1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:53.530765 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f396d0ab-39b3-49c8-87de-cb34c3cac5d1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:53.531640 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f396d0ab-39b3-49c8-87de-cb34c3cac5d1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:53.532236 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f396d0ab-39b3-49c8-87de-cb34c3cac5d1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:53.532798 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f396d0ab-39b3-49c8-87de-cb34c3cac5d1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:53.576870 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:14:53.879460 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-f396d0ab-39b3-49c8-87de-cb34c3cac5d1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:53.891501 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-f396d0ab-39b3-49c8-87de-cb34c3cac5d1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:53.893946 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-f396d0ab-39b3-49c8-87de-cb34c3cac5d1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:53.895404 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-f396d0ab-39b3-49c8-87de-cb34c3cac5d1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1737 microversion: 2.20 time: 0.420331 Oct 24 13:14:53.895794 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 173/339] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:53 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1737 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:14:54.061391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-bd9a3b3f-d680-4378-aa69-5a2fb9a258b0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:54.080518 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-bd9a3b3f-d680-4378-aa69-5a2fb9a258b0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:54.086942 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bd9a3b3f-d680-4378-aa69-5a2fb9a258b0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:54.087774 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bd9a3b3f-d680-4378-aa69-5a2fb9a258b0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:54.088403 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bd9a3b3f-d680-4378-aa69-5a2fb9a258b0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:54.090001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bd9a3b3f-d680-4378-aa69-5a2fb9a258b0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:54.090653 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bd9a3b3f-d680-4378-aa69-5a2fb9a258b0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:54.091297 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bd9a3b3f-d680-4378-aa69-5a2fb9a258b0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:54.184514 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-cc917905-3a11-48c0-a79f-a1ea169b2983 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:54.185724 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-cc917905-3a11-48c0-a79f-a1ea169b2983 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:54.198143 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cc917905-3a11-48c0-a79f-a1ea169b2983 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:54.200195 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cc917905-3a11-48c0-a79f-a1ea169b2983 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:54.200971 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cc917905-3a11-48c0-a79f-a1ea169b2983 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:54.203079 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cc917905-3a11-48c0-a79f-a1ea169b2983 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:54.203756 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cc917905-3a11-48c0-a79f-a1ea169b2983 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:54.204413 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cc917905-3a11-48c0-a79f-a1ea169b2983 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:54.457389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-cc917905-3a11-48c0-a79f-a1ea169b2983 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:54.466504 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-cc917905-3a11-48c0-a79f-a1ea169b2983 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541" status: 200 len: 1503 microversion: 2.1 time: 0.287486 Oct 24 13:14:54.468712 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 174/340] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:54 2022] GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541 => generated 1503 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:54.502814 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-bd9a3b3f-d680-4378-aa69-5a2fb9a258b0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:54.517745 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-bd9a3b3f-d680-4378-aa69-5a2fb9a258b0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1557 microversion: 2.1 time: 0.461152 Oct 24 13:14:54.518342 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 167/341] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:54 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1557 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:54.542038 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-b16a637e-6330-48c9-a945-23075388d7a8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:54.543479 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-b16a637e-6330-48c9-a945-23075388d7a8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:54.550128 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b16a637e-6330-48c9-a945-23075388d7a8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:54.551034 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b16a637e-6330-48c9-a945-23075388d7a8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:54.551731 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b16a637e-6330-48c9-a945-23075388d7a8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:54.552665 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b16a637e-6330-48c9-a945-23075388d7a8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:54.553340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b16a637e-6330-48c9-a945-23075388d7a8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:54.553995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b16a637e-6330-48c9-a945-23075388d7a8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:54.659900 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-b16a637e-6330-48c9-a945-23075388d7a8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122180 Oct 24 13:14:54.661360 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 175/342] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Oct 24 13:14:54 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:14:54.931915 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-7d0d50f1-d893-4bb3-9dc4-5ebb8b2ceee5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:54.932582 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-7d0d50f1-d893-4bb3-9dc4-5ebb8b2ceee5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:54.947610 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7d0d50f1-d893-4bb3-9dc4-5ebb8b2ceee5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:54.948290 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7d0d50f1-d893-4bb3-9dc4-5ebb8b2ceee5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:54.949436 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7d0d50f1-d893-4bb3-9dc4-5ebb8b2ceee5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:54.950323 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7d0d50f1-d893-4bb3-9dc4-5ebb8b2ceee5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:54.951829 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7d0d50f1-d893-4bb3-9dc4-5ebb8b2ceee5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:54.952491 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7d0d50f1-d893-4bb3-9dc4-5ebb8b2ceee5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:55.069627 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-4848f81a-f170-48dc-8f8d-1eb3fd329b2d req-106dbcab-fcb1-4736-8704-cc7f89794a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c60f48-8ebd-45ea-880a-c786cf73b541", "name": "network-vif-deleted", "tag": "71e22cc0-7b16-4e0f-bd74-9915e3a6bc11"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:55.105205 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-4848f81a-f170-48dc-8f8d-1eb3fd329b2d req-106dbcab-fcb1-4736-8704-cc7f89794a0e service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:55.106436 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-4848f81a-f170-48dc-8f8d-1eb3fd329b2d req-106dbcab-fcb1-4736-8704-cc7f89794a0e service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:55.106960 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-4848f81a-f170-48dc-8f8d-1eb3fd329b2d req-106dbcab-fcb1-4736-8704-cc7f89794a0e service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:55.121232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-4848f81a-f170-48dc-8f8d-1eb3fd329b2d req-106dbcab-fcb1-4736-8704-cc7f89794a0e service nova] Creating event network-vif-deleted:71e22cc0-7b16-4e0f-bd74-9915e3a6bc11 for instance 76c60f48-8ebd-45ea-880a-c786cf73b541 on hv-cinder-86248 Oct 24 13:14:55.140849 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-4848f81a-f170-48dc-8f8d-1eb3fd329b2d req-106dbcab-fcb1-4736-8704-cc7f89794a0e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082890 Oct 24 13:14:55.141984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 176/343] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:14:55.208668 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-7d0d50f1-d893-4bb3-9dc4-5ebb8b2ceee5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:55.241714 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-7d0d50f1-d893-4bb3-9dc4-5ebb8b2ceee5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:55.244586 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-7d0d50f1-d893-4bb3-9dc4-5ebb8b2ceee5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:55.248854 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-7d0d50f1-d893-4bb3-9dc4-5ebb8b2ceee5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1737 microversion: 2.20 time: 0.321040 Oct 24 13:14:55.249758 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 168/344] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:54 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1737 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:14:55.492078 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-e72656f7-e79b-484d-b2f8-288cd47dcdeb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:55.492767 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-e72656f7-e79b-484d-b2f8-288cd47dcdeb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:55.499252 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e72656f7-e79b-484d-b2f8-288cd47dcdeb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:55.499743 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e72656f7-e79b-484d-b2f8-288cd47dcdeb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:55.500176 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e72656f7-e79b-484d-b2f8-288cd47dcdeb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:55.500874 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e72656f7-e79b-484d-b2f8-288cd47dcdeb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:55.501326 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e72656f7-e79b-484d-b2f8-288cd47dcdeb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:55.501779 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e72656f7-e79b-484d-b2f8-288cd47dcdeb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:55.537368 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e72656f7-e79b-484d-b2f8-288cd47dcdeb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:55.537855 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e72656f7-e79b-484d-b2f8-288cd47dcdeb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:55.538286 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e72656f7-e79b-484d-b2f8-288cd47dcdeb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:55.538732 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.objects.instance [None req-e72656f7-e79b-484d-b2f8-288cd47dcdeb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lazy-loading 'fault' on Instance uuid 76c60f48-8ebd-45ea-880a-c786cf73b541 {{(pid=118914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:14:55.771663 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-e72656f7-e79b-484d-b2f8-288cd47dcdeb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd3d61c9fad4ac8ae26433ec77cd9c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b028ba991e14292803f73d38f7003dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:55.780920 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-e72656f7-e79b-484d-b2f8-288cd47dcdeb tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541" status: 200 len: 1303 microversion: 2.1 time: 0.293013 Oct 24 13:14:55.782065 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 177/345] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:55 2022] GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541 => generated 1303 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:14:56.178446 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-0b443e62-4f8e-402e-8eb0-2ec96668625c req-b4017dd2-3f04-4c67-a610-cf7ea342e2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc138711-ddfb-4b61-bf88-532641a857cd", "tag": "37f90190-526c-4317-90a1-c6197bdf36c1"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:14:56.188831 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-0b443e62-4f8e-402e-8eb0-2ec96668625c req-b4017dd2-3f04-4c67-a610-cf7ea342e2b9 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:56.189305 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-0b443e62-4f8e-402e-8eb0-2ec96668625c req-b4017dd2-3f04-4c67-a610-cf7ea342e2b9 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:56.189732 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-0b443e62-4f8e-402e-8eb0-2ec96668625c req-b4017dd2-3f04-4c67-a610-cf7ea342e2b9 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:56.206960 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-0b443e62-4f8e-402e-8eb0-2ec96668625c req-b4017dd2-3f04-4c67-a610-cf7ea342e2b9 service nova] Creating event network-changed:37f90190-526c-4317-90a1-c6197bdf36c1 for instance dc138711-ddfb-4b61-bf88-532641a857cd on hv-cinder-86248 Oct 24 13:14:56.211994 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-0b443e62-4f8e-402e-8eb0-2ec96668625c req-b4017dd2-3f04-4c67-a610-cf7ea342e2b9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037186 Oct 24 13:14:56.212739 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 169/346] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:14:56.280107 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-ff90a71f-59e6-4903-a94c-3d89a8c8ca56 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:56.281708 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-ff90a71f-59e6-4903-a94c-3d89a8c8ca56 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:56.289448 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ff90a71f-59e6-4903-a94c-3d89a8c8ca56 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:56.289942 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ff90a71f-59e6-4903-a94c-3d89a8c8ca56 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:56.290380 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ff90a71f-59e6-4903-a94c-3d89a8c8ca56 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:56.291115 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ff90a71f-59e6-4903-a94c-3d89a8c8ca56 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:56.291578 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ff90a71f-59e6-4903-a94c-3d89a8c8ca56 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:56.292002 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ff90a71f-59e6-4903-a94c-3d89a8c8ca56 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:56.466749 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-ff90a71f-59e6-4903-a94c-3d89a8c8ca56 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:56.475914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-ff90a71f-59e6-4903-a94c-3d89a8c8ca56 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:56.477874 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-ff90a71f-59e6-4903-a94c-3d89a8c8ca56 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:56.480625 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-ff90a71f-59e6-4903-a94c-3d89a8c8ca56 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1719 microversion: 2.20 time: 0.203640 Oct 24 13:14:56.481466 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 178/347] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:56 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1719 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:14:56.806386 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-719ea623-086b-400c-89b5-4c04ec1ae502 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:56.807397 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-719ea623-086b-400c-89b5-4c04ec1ae502 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] [instance: 76c60f48-8ebd-45ea-880a-c786cf73b541] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:56.815187 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-719ea623-086b-400c-89b5-4c04ec1ae502 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:56.816424 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-719ea623-086b-400c-89b5-4c04ec1ae502 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:56.817664 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-719ea623-086b-400c-89b5-4c04ec1ae502 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:56.819314 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-719ea623-086b-400c-89b5-4c04ec1ae502 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:56.820032 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-719ea623-086b-400c-89b5-4c04ec1ae502 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:56.822643 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-719ea623-086b-400c-89b5-4c04ec1ae502 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:56.837007 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-719ea623-086b-400c-89b5-4c04ec1ae502 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] HTTP exception thrown: Instance 76c60f48-8ebd-45ea-880a-c786cf73b541 could not be found. Oct 24 13:14:56.838928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-719ea623-086b-400c-89b5-4c04ec1ae502 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Request method failure captured: Oct 24 13:14:56.838928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541 HTTP/1.1 Oct 24 13:14:56.838928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:14:56.838928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:14:56.838928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:14:56.838928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:14:56.838928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:14:56.838928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:14:56.838928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:14:56.838928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:14:56.838928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo-a_-W-a1BJ8_1ke14FTmsSNST4NDzvN-EgUSjdLo5evVGWb5w4G0iXTdY9LWqSFvNpAkvyxkLA3sdTRdDS9ZRp6WR6d0wHGHYIcIjhkKtOdAa-FtWo73SI623sg1BGVFkmS7ZAzJ8Ua0sdIh6FaJdpruLuAHLUW_xRWiwzFf4rud8 Oct 24 13:14:56.838928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:14:56.838928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:14:56.838928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:14:56.838928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:14:56.838928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:14:56.838928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:14:56.838928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: 5b028ba991e14292803f73d38f7003dc Oct 24 13:14:56.838928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-VolumesActionsTest-1149227572 Oct 24 13:14:56.838928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:14:56.838928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:14:56.840493 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5b028ba991e14292803f73d38f7003dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5b028ba991e14292803f73d38f7003dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5b028ba991e14292803f73d38f7003dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5b028ba991e14292803f73d38f7003dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:14:56.840493 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-VolumesActionsTest-1149227572 Oct 24 13:14:56.840493 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: 5b028ba991e14292803f73d38f7003dc Oct 24 13:14:56.840493 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-VolumesActionsTest-1149227572 Oct 24 13:14:56.840493 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-VolumesActionsTest-1149227572-project Oct 24 13:14:56.840493 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:14:56.840493 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:14:56.840493 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: 1fd3d61c9fad4ac8ae26433ec77cd9c8 Oct 24 13:14:56.840493 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-VolumesActionsTest-1149227572-project Oct 24 13:14:56.840493 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:14:56.840493 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Instance 76c60f48-8ebd-45ea-880a-c786cf73b541 could not be found. Oct 24 13:14:56.840493 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': '76c60f48-8ebd-45ea-880a-c786cf73b541'} Oct 24 13:14:56.841212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:14:56.841212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:14:56.841212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:14:56.841212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:14:56.841212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:14:56.841212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:14:56.841212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:14:56.841212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:14:56.841212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:14:56.841212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:14:56.841212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76c60f48-8ebd-45ea-880a-c786cf73b541 could not be found. Oct 24 13:14:56.841212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:14:56.841212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:14:56.841212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:14:56.841212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:14:56.841212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:14:56.841212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:14:56.841212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:14:56.841212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:14:56.841212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:14:56.842374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:14:56.842374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:14:56.842374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:14:56.842374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:14:56.842374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:14:56.842374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:14:56.842374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:14:56.842374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76c60f48-8ebd-45ea-880a-c786cf73b541 could not be found. Oct 24 13:14:56.842374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:14:56.842374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:14:56.842374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:14:56.842374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:14:56.842374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:14:56.842374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:14:56.842374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:14:56.842374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:14:56.842374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76c60f48-8ebd-45ea-880a-c786cf73b541 could not be found. Oct 24 13:14:56.842374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:14:56.844659 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-719ea623-086b-400c-89b5-4c04ec1ae502 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] Returning 404 to user: Instance 76c60f48-8ebd-45ea-880a-c786cf73b541 could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:14:56.844659 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-719ea623-086b-400c-89b5-4c04ec1ae502 tempest-VolumesActionsTest-1149227572 tempest-VolumesActionsTest-1149227572-project] 10.222.0.42 "GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541" status: 404 len: 111 microversion: 2.1 time: 0.038591 Oct 24 13:14:56.849138 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 170/348] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:14:56 2022] GET /compute/v2.1/servers/76c60f48-8ebd-45ea-880a-c786cf73b541 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:14:57.509564 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a6ce2043-ae60-47f5-ad6b-f11597ce64e4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:57.510519 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a6ce2043-ae60-47f5-ad6b-f11597ce64e4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:57.519786 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a6ce2043-ae60-47f5-ad6b-f11597ce64e4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:57.520174 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a6ce2043-ae60-47f5-ad6b-f11597ce64e4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:57.521097 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a6ce2043-ae60-47f5-ad6b-f11597ce64e4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:57.522371 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a6ce2043-ae60-47f5-ad6b-f11597ce64e4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:57.523282 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a6ce2043-ae60-47f5-ad6b-f11597ce64e4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:57.524177 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a6ce2043-ae60-47f5-ad6b-f11597ce64e4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:57.690838 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a6ce2043-ae60-47f5-ad6b-f11597ce64e4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:57.699013 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a6ce2043-ae60-47f5-ad6b-f11597ce64e4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:57.700543 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a6ce2043-ae60-47f5-ad6b-f11597ce64e4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:57.701659 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a6ce2043-ae60-47f5-ad6b-f11597ce64e4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1719 microversion: 2.20 time: 0.195899 Oct 24 13:14:57.702731 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 179/349] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:57 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1719 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:14:58.728454 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-b25bb072-c4d3-4f1e-9ea7-7122cf4935c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:58.729057 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-b25bb072-c4d3-4f1e-9ea7-7122cf4935c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:58.735860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b25bb072-c4d3-4f1e-9ea7-7122cf4935c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:58.736332 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b25bb072-c4d3-4f1e-9ea7-7122cf4935c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:58.736756 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b25bb072-c4d3-4f1e-9ea7-7122cf4935c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:58.737431 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b25bb072-c4d3-4f1e-9ea7-7122cf4935c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:58.737879 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b25bb072-c4d3-4f1e-9ea7-7122cf4935c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:58.738297 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b25bb072-c4d3-4f1e-9ea7-7122cf4935c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:58.878602 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-b25bb072-c4d3-4f1e-9ea7-7122cf4935c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:58.886955 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-b25bb072-c4d3-4f1e-9ea7-7122cf4935c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:58.888403 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-b25bb072-c4d3-4f1e-9ea7-7122cf4935c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:14:58.889542 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-b25bb072-c4d3-4f1e-9ea7-7122cf4935c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1719 microversion: 2.20 time: 0.164975 Oct 24 13:14:58.890089 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 171/350] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:58 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:14:59.914859 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-9a7e24cb-f57a-4a4c-8955-5631dfaf793c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:14:59.915500 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-9a7e24cb-f57a-4a4c-8955-5631dfaf793c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:14:59.922457 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9a7e24cb-f57a-4a4c-8955-5631dfaf793c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:59.922869 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9a7e24cb-f57a-4a4c-8955-5631dfaf793c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:59.923334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9a7e24cb-f57a-4a4c-8955-5631dfaf793c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:14:59.924008 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9a7e24cb-f57a-4a4c-8955-5631dfaf793c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:14:59.924453 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9a7e24cb-f57a-4a4c-8955-5631dfaf793c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:14:59.924869 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9a7e24cb-f57a-4a4c-8955-5631dfaf793c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:00.055699 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-9a7e24cb-f57a-4a4c-8955-5631dfaf793c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:00.064561 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-9a7e24cb-f57a-4a4c-8955-5631dfaf793c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:00.066199 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-9a7e24cb-f57a-4a4c-8955-5631dfaf793c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:00.067513 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-9a7e24cb-f57a-4a4c-8955-5631dfaf793c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1719 microversion: 2.20 time: 0.156560 Oct 24 13:15:00.068260 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 180/351] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:14:59 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:00.132408 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-404ec71e-94ac-457a-8330-71bc08d6400d req-677ec693-ad76-486f-bba5-7b8b4c25216f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b5963f-5199-4822-a8c3-20a8ab09224f", "name": "network-vif-unplugged", "status": "completed", "tag": "9241fec5-c702-4043-a917-794ed6ca4105"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:15:00.143677 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-404ec71e-94ac-457a-8330-71bc08d6400d req-677ec693-ad76-486f-bba5-7b8b4c25216f service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:00.144156 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-404ec71e-94ac-457a-8330-71bc08d6400d req-677ec693-ad76-486f-bba5-7b8b4c25216f service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:00.144589 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-404ec71e-94ac-457a-8330-71bc08d6400d req-677ec693-ad76-486f-bba5-7b8b4c25216f service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:00.155608 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-404ec71e-94ac-457a-8330-71bc08d6400d req-677ec693-ad76-486f-bba5-7b8b4c25216f service nova] Creating event network-vif-unplugged:9241fec5-c702-4043-a917-794ed6ca4105 for instance 27b5963f-5199-4822-a8c3-20a8ab09224f on hv-cinder-86248 Oct 24 13:15:00.160653 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-404ec71e-94ac-457a-8330-71bc08d6400d req-677ec693-ad76-486f-bba5-7b8b4c25216f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031891 Oct 24 13:15:00.161498 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 172/352] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:15:01.093645 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-bbb645af-fc43-4324-bd86-d4f3fe5c6d78 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:01.094256 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-bbb645af-fc43-4324-bd86-d4f3fe5c6d78 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:01.100747 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bbb645af-fc43-4324-bd86-d4f3fe5c6d78 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:01.101233 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bbb645af-fc43-4324-bd86-d4f3fe5c6d78 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:01.101666 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bbb645af-fc43-4324-bd86-d4f3fe5c6d78 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:01.102357 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bbb645af-fc43-4324-bd86-d4f3fe5c6d78 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:01.102812 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bbb645af-fc43-4324-bd86-d4f3fe5c6d78 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:01.103274 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bbb645af-fc43-4324-bd86-d4f3fe5c6d78 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:01.234707 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-bbb645af-fc43-4324-bd86-d4f3fe5c6d78 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:01.242766 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-bbb645af-fc43-4324-bd86-d4f3fe5c6d78 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:01.244235 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-bbb645af-fc43-4324-bd86-d4f3fe5c6d78 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:01.245386 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-bbb645af-fc43-4324-bd86-d4f3fe5c6d78 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1719 microversion: 2.20 time: 0.156384 Oct 24 13:15:01.245938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 181/353] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:01 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:02.272319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-aa68a64f-1c13-4f0a-bd62-923ba09c8407 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:02.273008 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-aa68a64f-1c13-4f0a-bd62-923ba09c8407 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:02.279937 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aa68a64f-1c13-4f0a-bd62-923ba09c8407 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:02.280417 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aa68a64f-1c13-4f0a-bd62-923ba09c8407 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:02.280846 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aa68a64f-1c13-4f0a-bd62-923ba09c8407 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:02.281535 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aa68a64f-1c13-4f0a-bd62-923ba09c8407 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:02.282093 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aa68a64f-1c13-4f0a-bd62-923ba09c8407 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:02.282529 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aa68a64f-1c13-4f0a-bd62-923ba09c8407 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:02.438809 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-aa68a64f-1c13-4f0a-bd62-923ba09c8407 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:02.448847 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-aa68a64f-1c13-4f0a-bd62-923ba09c8407 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:02.450320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-aa68a64f-1c13-4f0a-bd62-923ba09c8407 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:02.451730 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-aa68a64f-1c13-4f0a-bd62-923ba09c8407 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1722 microversion: 2.20 time: 0.184292 Oct 24 13:15:02.452434 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 173/354] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:02 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:15:02.477889 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-60c1c874-3e63-4c52-974c-a018ed014260 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5bd14cc-b177-4b7f-b96e-12a6f9ad5374"}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:15:02.480978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-60c1c874-3e63-4c52-974c-a018ed014260 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:02.487841 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-60c1c874-3e63-4c52-974c-a018ed014260 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:02.488323 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-60c1c874-3e63-4c52-974c-a018ed014260 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:02.488756 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-60c1c874-3e63-4c52-974c-a018ed014260 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:02.489450 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-60c1c874-3e63-4c52-974c-a018ed014260 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:02.489909 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-60c1c874-3e63-4c52-974c-a018ed014260 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:02.490326 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-60c1c874-3e63-4c52-974c-a018ed014260 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:02.568179 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-2b52ca4c-714c-4fdf-803d-105412390ad5 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:15:02.575501 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2b52ca4c-714c-4fdf-803d-105412390ad5 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:02.575988 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2b52ca4c-714c-4fdf-803d-105412390ad5 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:02.576412 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2b52ca4c-714c-4fdf-803d-105412390ad5 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:02.653126 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-2b52ca4c-714c-4fdf-803d-105412390ad5 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Going to try to stop instance {{(pid=118915) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 13:15:02.702284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-2b52ca4c-714c-4fdf-803d-105412390ad5 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "POST /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf/action" status: 202 len: 0 microversion: 2.1 time: 0.137305 Oct 24 13:15:02.703022 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 174/355] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 24 13:15:02 2022] POST /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 13:15:02.712319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-3aa1aabd-bfac-46a2-8375-b26764562949 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:02.713231 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-3aa1aabd-bfac-46a2-8375-b26764562949 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:02.720636 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3aa1aabd-bfac-46a2-8375-b26764562949 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:02.721117 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3aa1aabd-bfac-46a2-8375-b26764562949 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:02.721552 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3aa1aabd-bfac-46a2-8375-b26764562949 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:02.722384 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3aa1aabd-bfac-46a2-8375-b26764562949 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:02.722952 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3aa1aabd-bfac-46a2-8375-b26764562949 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:02.723400 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3aa1aabd-bfac-46a2-8375-b26764562949 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:02.865765 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-60c1c874-3e63-4c52-974c-a018ed014260 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "POST /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.391764 Oct 24 13:15:02.867122 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 182/356] 10.222.0.42 () {62 vars in 1364 bytes} [Mon Oct 24 13:15:02 2022] POST /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments => generated 188 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:15:02.908971 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-3aa1aabd-bfac-46a2-8375-b26764562949 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:02.929643 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-3aa1aabd-bfac-46a2-8375-b26764562949 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1723 microversion: 2.1 time: 0.218048 Oct 24 13:15:02.931174 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 175/357] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:02 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:15:03.084660 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-5a824d3d-590d-4f39-80de-eec8e7c20fc7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:15:03.086302 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-5a824d3d-590d-4f39-80de-eec8e7c20fc7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:03.096567 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5a824d3d-590d-4f39-80de-eec8e7c20fc7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:03.097344 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5a824d3d-590d-4f39-80de-eec8e7c20fc7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:03.097776 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5a824d3d-590d-4f39-80de-eec8e7c20fc7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:03.098638 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5a824d3d-590d-4f39-80de-eec8e7c20fc7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:03.099114 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5a824d3d-590d-4f39-80de-eec8e7c20fc7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:03.099717 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5a824d3d-590d-4f39-80de-eec8e7c20fc7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:03.178449 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-5a824d3d-590d-4f39-80de-eec8e7c20fc7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118914) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 24 13:15:03.263952 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-5a824d3d-590d-4f39-80de-eec8e7c20fc7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "POST /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/action" status: 202 len: 0 microversion: 2.20 time: 0.183000 Oct 24 13:15:03.267105 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 183/358] 10.222.0.42 () {62 vars in 1319 bytes} [Mon Oct 24 13:15:03 2022] POST /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:15:03.273199 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-de43da69-487d-4686-9c98-a6439bddca3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:03.274757 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-de43da69-487d-4686-9c98-a6439bddca3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:03.283728 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-de43da69-487d-4686-9c98-a6439bddca3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:03.284390 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-de43da69-487d-4686-9c98-a6439bddca3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:03.285154 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-de43da69-487d-4686-9c98-a6439bddca3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:03.286477 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-de43da69-487d-4686-9c98-a6439bddca3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:03.287680 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-de43da69-487d-4686-9c98-a6439bddca3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:03.288200 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-de43da69-487d-4686-9c98-a6439bddca3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:03.509270 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-de43da69-487d-4686-9c98-a6439bddca3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:03.519410 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-de43da69-487d-4686-9c98-a6439bddca3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:03.521658 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-de43da69-487d-4686-9c98-a6439bddca3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:03.523963 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-de43da69-487d-4686-9c98-a6439bddca3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1748 microversion: 2.20 time: 0.254606 Oct 24 13:15:03.525460 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 176/359] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:03 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1748 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:03.958670 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-40c3cd9f-f1e8-4896-ad49-693a774bc355 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:03.959329 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-40c3cd9f-f1e8-4896-ad49-693a774bc355 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:03.970148 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40c3cd9f-f1e8-4896-ad49-693a774bc355 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:03.971400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40c3cd9f-f1e8-4896-ad49-693a774bc355 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:03.972059 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40c3cd9f-f1e8-4896-ad49-693a774bc355 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:03.972932 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40c3cd9f-f1e8-4896-ad49-693a774bc355 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:03.973397 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40c3cd9f-f1e8-4896-ad49-693a774bc355 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:03.973826 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40c3cd9f-f1e8-4896-ad49-693a774bc355 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:04.207339 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-40c3cd9f-f1e8-4896-ad49-693a774bc355 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:04.236695 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-40c3cd9f-f1e8-4896-ad49-693a774bc355 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1723 microversion: 2.1 time: 0.282949 Oct 24 13:15:04.239067 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 184/360] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:03 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1723 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:04.557431 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-0f7831c5-393d-49b7-bff0-ae4ced200190 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:04.560802 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-0f7831c5-393d-49b7-bff0-ae4ced200190 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:04.571159 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f7831c5-393d-49b7-bff0-ae4ced200190 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:04.574404 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f7831c5-393d-49b7-bff0-ae4ced200190 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:04.575188 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f7831c5-393d-49b7-bff0-ae4ced200190 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:04.576125 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f7831c5-393d-49b7-bff0-ae4ced200190 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:04.576788 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f7831c5-393d-49b7-bff0-ae4ced200190 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:04.577432 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f7831c5-393d-49b7-bff0-ae4ced200190 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:04.727537 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-0f7831c5-393d-49b7-bff0-ae4ced200190 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:04.736210 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-0f7831c5-393d-49b7-bff0-ae4ced200190 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:04.737649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-0f7831c5-393d-49b7-bff0-ae4ced200190 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:04.738812 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-0f7831c5-393d-49b7-bff0-ae4ced200190 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1748 microversion: 2.20 time: 0.188692 Oct 24 13:15:04.739399 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 177/361] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:04 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1748 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:05.265966 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-15e10624-ccf0-4824-a429-d7976060e109 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:05.267216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-15e10624-ccf0-4824-a429-d7976060e109 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:05.276134 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-15e10624-ccf0-4824-a429-d7976060e109 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:05.277283 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-15e10624-ccf0-4824-a429-d7976060e109 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:05.280141 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-15e10624-ccf0-4824-a429-d7976060e109 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:05.283325 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-15e10624-ccf0-4824-a429-d7976060e109 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:05.284131 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-15e10624-ccf0-4824-a429-d7976060e109 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:05.285748 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-15e10624-ccf0-4824-a429-d7976060e109 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:05.472815 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-15e10624-ccf0-4824-a429-d7976060e109 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:05.486230 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-15e10624-ccf0-4824-a429-d7976060e109 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1723 microversion: 2.1 time: 0.223976 Oct 24 13:15:05.487276 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 185/362] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:05 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:05.801435 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-34824839-85fd-4ce0-822a-1f618c70a74f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:05.813155 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-34824839-85fd-4ce0-822a-1f618c70a74f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:05.830365 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-34824839-85fd-4ce0-822a-1f618c70a74f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:05.831194 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-34824839-85fd-4ce0-822a-1f618c70a74f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:05.832005 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-34824839-85fd-4ce0-822a-1f618c70a74f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:05.834270 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-34824839-85fd-4ce0-822a-1f618c70a74f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:05.838732 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-34824839-85fd-4ce0-822a-1f618c70a74f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:05.840063 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-34824839-85fd-4ce0-822a-1f618c70a74f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:06.180315 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-34824839-85fd-4ce0-822a-1f618c70a74f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:06.190996 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-34824839-85fd-4ce0-822a-1f618c70a74f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:06.192475 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-34824839-85fd-4ce0-822a-1f618c70a74f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:06.193665 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-34824839-85fd-4ce0-822a-1f618c70a74f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.407525 Oct 24 13:15:06.194254 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 178/363] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:05 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:06.515093 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-eca27732-65b4-4370-9f90-4d706c95d3c0 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:06.515917 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-eca27732-65b4-4370-9f90-4d706c95d3c0 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:06.522744 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-eca27732-65b4-4370-9f90-4d706c95d3c0 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:06.523441 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-eca27732-65b4-4370-9f90-4d706c95d3c0 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:06.523993 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-eca27732-65b4-4370-9f90-4d706c95d3c0 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:06.524953 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-eca27732-65b4-4370-9f90-4d706c95d3c0 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:06.525500 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-eca27732-65b4-4370-9f90-4d706c95d3c0 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:06.526022 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-eca27732-65b4-4370-9f90-4d706c95d3c0 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:06.686076 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-eca27732-65b4-4370-9f90-4d706c95d3c0 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:06.701316 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-eca27732-65b4-4370-9f90-4d706c95d3c0 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1723 microversion: 2.1 time: 0.190917 Oct 24 13:15:06.707620 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 186/364] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:06 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:07.230912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-25d3d090-c08f-4f83-a1fd-57b96f296ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:07.236252 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-25d3d090-c08f-4f83-a1fd-57b96f296ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:07.257959 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-25d3d090-c08f-4f83-a1fd-57b96f296ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:07.258763 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-25d3d090-c08f-4f83-a1fd-57b96f296ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:07.259228 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-25d3d090-c08f-4f83-a1fd-57b96f296ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:07.259933 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-25d3d090-c08f-4f83-a1fd-57b96f296ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:07.260707 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-25d3d090-c08f-4f83-a1fd-57b96f296ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:07.261378 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-25d3d090-c08f-4f83-a1fd-57b96f296ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:07.358825 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-581f9123-0edb-4fc7-ba87-67fc9f5bf139 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "614fc30e-9c85-44d4-9b6b-a12da71d73c4", "device": "/dev/sdb"}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:15:07.362119 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-581f9123-0edb-4fc7-ba87-67fc9f5bf139 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:07.378173 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-581f9123-0edb-4fc7-ba87-67fc9f5bf139 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:07.383148 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-581f9123-0edb-4fc7-ba87-67fc9f5bf139 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:07.383869 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-581f9123-0edb-4fc7-ba87-67fc9f5bf139 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:07.384648 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-581f9123-0edb-4fc7-ba87-67fc9f5bf139 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:07.386174 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-581f9123-0edb-4fc7-ba87-67fc9f5bf139 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:07.386801 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-581f9123-0edb-4fc7-ba87-67fc9f5bf139 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:07.394505 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:07.566552 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-25d3d090-c08f-4f83-a1fd-57b96f296ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:07.579391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-25d3d090-c08f-4f83-a1fd-57b96f296ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:07.582012 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-25d3d090-c08f-4f83-a1fd-57b96f296ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:07.583951 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-25d3d090-c08f-4f83-a1fd-57b96f296ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.357605 Oct 24 13:15:07.585363 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 179/365] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:07 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:07.730598 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-c01324bf-9c1d-4f4f-8dfe-23262d9447d9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:07.731776 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-c01324bf-9c1d-4f4f-8dfe-23262d9447d9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:07.743381 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c01324bf-9c1d-4f4f-8dfe-23262d9447d9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:07.744259 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c01324bf-9c1d-4f4f-8dfe-23262d9447d9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:07.746149 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c01324bf-9c1d-4f4f-8dfe-23262d9447d9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:07.748428 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c01324bf-9c1d-4f4f-8dfe-23262d9447d9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:07.749035 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c01324bf-9c1d-4f4f-8dfe-23262d9447d9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:07.749821 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c01324bf-9c1d-4f4f-8dfe-23262d9447d9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:07.762395 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-581f9123-0edb-4fc7-ba87-67fc9f5bf139 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "POST /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412523 Oct 24 13:15:07.780123 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 187/366] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 24 13:15:07 2022] POST /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde/os-volume_attachments => generated 194 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:15:07.980296 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-c01324bf-9c1d-4f4f-8dfe-23262d9447d9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:07.991151 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-c01324bf-9c1d-4f4f-8dfe-23262d9447d9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1723 microversion: 2.1 time: 0.266089 Oct 24 13:15:07.992596 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 180/367] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:07 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:08.614116 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-147dc923-f89b-449c-aed3-ded6396e36a1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:08.615235 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-147dc923-f89b-449c-aed3-ded6396e36a1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:08.622006 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-147dc923-f89b-449c-aed3-ded6396e36a1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:08.622559 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-147dc923-f89b-449c-aed3-ded6396e36a1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:08.623200 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-147dc923-f89b-449c-aed3-ded6396e36a1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:08.624062 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-147dc923-f89b-449c-aed3-ded6396e36a1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:08.624649 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-147dc923-f89b-449c-aed3-ded6396e36a1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:08.625264 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-147dc923-f89b-449c-aed3-ded6396e36a1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:08.788333 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-147dc923-f89b-449c-aed3-ded6396e36a1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:08.800297 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-147dc923-f89b-449c-aed3-ded6396e36a1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:08.802287 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-147dc923-f89b-449c-aed3-ded6396e36a1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:08.803720 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-147dc923-f89b-449c-aed3-ded6396e36a1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.194549 Oct 24 13:15:08.819087 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 188/368] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:08 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:09.030497 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-b8830bcc-c811-4cd2-92e0-4a88efd5fe9e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:09.032240 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-b8830bcc-c811-4cd2-92e0-4a88efd5fe9e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:09.059313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b8830bcc-c811-4cd2-92e0-4a88efd5fe9e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:09.067468 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b8830bcc-c811-4cd2-92e0-4a88efd5fe9e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:09.075836 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b8830bcc-c811-4cd2-92e0-4a88efd5fe9e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:09.077330 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b8830bcc-c811-4cd2-92e0-4a88efd5fe9e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:09.077980 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b8830bcc-c811-4cd2-92e0-4a88efd5fe9e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:09.078588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b8830bcc-c811-4cd2-92e0-4a88efd5fe9e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:09.261824 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-b8830bcc-c811-4cd2-92e0-4a88efd5fe9e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:09.272457 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-b8830bcc-c811-4cd2-92e0-4a88efd5fe9e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1723 microversion: 2.1 time: 0.250818 Oct 24 13:15:09.273650 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 181/369] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:09 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:09.831303 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-dbfd3882-e269-4ceb-bc1c-181584977887 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:09.832704 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-dbfd3882-e269-4ceb-bc1c-181584977887 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:09.840503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dbfd3882-e269-4ceb-bc1c-181584977887 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:09.841184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dbfd3882-e269-4ceb-bc1c-181584977887 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:09.841783 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dbfd3882-e269-4ceb-bc1c-181584977887 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:09.842860 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dbfd3882-e269-4ceb-bc1c-181584977887 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:09.843499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dbfd3882-e269-4ceb-bc1c-181584977887 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:09.844405 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dbfd3882-e269-4ceb-bc1c-181584977887 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:10.085214 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-dbfd3882-e269-4ceb-bc1c-181584977887 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:10.097712 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-dbfd3882-e269-4ceb-bc1c-181584977887 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:10.100278 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-dbfd3882-e269-4ceb-bc1c-181584977887 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:10.102958 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-dbfd3882-e269-4ceb-bc1c-181584977887 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.275290 Oct 24 13:15:10.104069 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 189/370] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:09 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:10.304828 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-2af09656-32dd-40bb-9fea-bac8deab698d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:10.305433 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-2af09656-32dd-40bb-9fea-bac8deab698d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:10.311784 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2af09656-32dd-40bb-9fea-bac8deab698d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:10.312496 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2af09656-32dd-40bb-9fea-bac8deab698d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:10.313105 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2af09656-32dd-40bb-9fea-bac8deab698d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:10.313998 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2af09656-32dd-40bb-9fea-bac8deab698d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:10.314658 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2af09656-32dd-40bb-9fea-bac8deab698d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:10.315099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2af09656-32dd-40bb-9fea-bac8deab698d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:10.553324 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-2af09656-32dd-40bb-9fea-bac8deab698d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:10.567463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-2af09656-32dd-40bb-9fea-bac8deab698d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1723 microversion: 2.1 time: 0.266723 Oct 24 13:15:10.568315 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 182/371] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:10 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:11.133037 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-28eac28e-db8f-48d9-b824-82038bcdd013 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:11.134420 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-28eac28e-db8f-48d9-b824-82038bcdd013 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:11.144340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-28eac28e-db8f-48d9-b824-82038bcdd013 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:11.145574 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-28eac28e-db8f-48d9-b824-82038bcdd013 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:11.146448 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-28eac28e-db8f-48d9-b824-82038bcdd013 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:11.148200 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-28eac28e-db8f-48d9-b824-82038bcdd013 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:11.148917 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-28eac28e-db8f-48d9-b824-82038bcdd013 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:11.149572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-28eac28e-db8f-48d9-b824-82038bcdd013 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:11.503934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-28eac28e-db8f-48d9-b824-82038bcdd013 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:11.519011 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-28eac28e-db8f-48d9-b824-82038bcdd013 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:11.521151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-28eac28e-db8f-48d9-b824-82038bcdd013 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:11.522835 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-28eac28e-db8f-48d9-b824-82038bcdd013 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.393775 Oct 24 13:15:11.523862 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 190/372] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:11 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:11.593354 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-d1bea08d-ace6-425d-8b71-da969dba2848 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:11.594951 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-d1bea08d-ace6-425d-8b71-da969dba2848 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:11.601961 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d1bea08d-ace6-425d-8b71-da969dba2848 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:11.602443 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d1bea08d-ace6-425d-8b71-da969dba2848 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:11.603284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d1bea08d-ace6-425d-8b71-da969dba2848 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:11.604208 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d1bea08d-ace6-425d-8b71-da969dba2848 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:11.605157 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d1bea08d-ace6-425d-8b71-da969dba2848 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:11.605157 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d1bea08d-ace6-425d-8b71-da969dba2848 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:11.825941 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-d1bea08d-ace6-425d-8b71-da969dba2848 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:11.838118 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-d1bea08d-ace6-425d-8b71-da969dba2848 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1723 microversion: 2.1 time: 0.250301 Oct 24 13:15:11.840489 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 183/373] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:11 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:12.560015 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c57b0af9-31f2-4b49-b0ed-3abd26f100bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:12.561293 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-c57b0af9-31f2-4b49-b0ed-3abd26f100bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:12.568845 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c57b0af9-31f2-4b49-b0ed-3abd26f100bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:12.569365 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c57b0af9-31f2-4b49-b0ed-3abd26f100bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:12.570093 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c57b0af9-31f2-4b49-b0ed-3abd26f100bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:12.571083 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c57b0af9-31f2-4b49-b0ed-3abd26f100bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:12.571536 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c57b0af9-31f2-4b49-b0ed-3abd26f100bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:12.571982 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c57b0af9-31f2-4b49-b0ed-3abd26f100bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:12.804392 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-c57b0af9-31f2-4b49-b0ed-3abd26f100bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:12.816458 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-c57b0af9-31f2-4b49-b0ed-3abd26f100bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:12.818216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-c57b0af9-31f2-4b49-b0ed-3abd26f100bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:12.819665 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-c57b0af9-31f2-4b49-b0ed-3abd26f100bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.264349 Oct 24 13:15:12.820920 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 191/374] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:12 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:12.866840 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-be749ca7-4d6e-400a-81c0-1251c2ffdf4d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:12.868168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-be749ca7-4d6e-400a-81c0-1251c2ffdf4d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:12.878074 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-be749ca7-4d6e-400a-81c0-1251c2ffdf4d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:12.878857 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-be749ca7-4d6e-400a-81c0-1251c2ffdf4d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:12.879517 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-be749ca7-4d6e-400a-81c0-1251c2ffdf4d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:12.880480 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-be749ca7-4d6e-400a-81c0-1251c2ffdf4d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:12.881103 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-be749ca7-4d6e-400a-81c0-1251c2ffdf4d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:12.882040 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-be749ca7-4d6e-400a-81c0-1251c2ffdf4d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:12.900254 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:13.090986 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-be749ca7-4d6e-400a-81c0-1251c2ffdf4d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:13.107395 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-be749ca7-4d6e-400a-81c0-1251c2ffdf4d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1723 microversion: 2.1 time: 0.247284 Oct 24 13:15:13.108304 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 184/375] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:12 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:13.846611 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-77a4d38f-6bc4-442b-89ce-8fd09fd97981 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:13.847353 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-77a4d38f-6bc4-442b-89ce-8fd09fd97981 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:13.866610 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-77a4d38f-6bc4-442b-89ce-8fd09fd97981 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:13.867545 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-77a4d38f-6bc4-442b-89ce-8fd09fd97981 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:13.868304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-77a4d38f-6bc4-442b-89ce-8fd09fd97981 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:13.869390 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-77a4d38f-6bc4-442b-89ce-8fd09fd97981 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:13.870669 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-77a4d38f-6bc4-442b-89ce-8fd09fd97981 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:13.871449 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-77a4d38f-6bc4-442b-89ce-8fd09fd97981 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:14.024444 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-77a4d38f-6bc4-442b-89ce-8fd09fd97981 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:14.034032 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-77a4d38f-6bc4-442b-89ce-8fd09fd97981 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:14.035673 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-77a4d38f-6bc4-442b-89ce-8fd09fd97981 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:14.037060 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-77a4d38f-6bc4-442b-89ce-8fd09fd97981 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.194883 Oct 24 13:15:14.047471 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 192/376] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:13 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:14.133067 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-ec953f6f-308e-467f-a13e-31e1d53c97d2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:14.133719 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-ec953f6f-308e-467f-a13e-31e1d53c97d2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:14.141173 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ec953f6f-308e-467f-a13e-31e1d53c97d2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:14.141689 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ec953f6f-308e-467f-a13e-31e1d53c97d2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:14.142099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ec953f6f-308e-467f-a13e-31e1d53c97d2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:14.142800 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ec953f6f-308e-467f-a13e-31e1d53c97d2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:14.143293 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ec953f6f-308e-467f-a13e-31e1d53c97d2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:14.143720 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ec953f6f-308e-467f-a13e-31e1d53c97d2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:14.302136 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-ec953f6f-308e-467f-a13e-31e1d53c97d2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:14.324065 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-ec953f6f-308e-467f-a13e-31e1d53c97d2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1723 microversion: 2.1 time: 0.194586 Oct 24 13:15:14.324944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 185/377] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:14 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:15.068072 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-03ae0e94-b5df-434d-a01a-a4d9f65dc0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:15.075844 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-03ae0e94-b5df-434d-a01a-a4d9f65dc0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:15.082997 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:15.084677 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-03ae0e94-b5df-434d-a01a-a4d9f65dc0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:15.087213 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-03ae0e94-b5df-434d-a01a-a4d9f65dc0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:15.087610 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-03ae0e94-b5df-434d-a01a-a4d9f65dc0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:15.096049 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-03ae0e94-b5df-434d-a01a-a4d9f65dc0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:15.096526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-03ae0e94-b5df-434d-a01a-a4d9f65dc0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:15.097172 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-03ae0e94-b5df-434d-a01a-a4d9f65dc0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:15.271892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-03ae0e94-b5df-434d-a01a-a4d9f65dc0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:15.281356 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-03ae0e94-b5df-434d-a01a-a4d9f65dc0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:15.282793 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-03ae0e94-b5df-434d-a01a-a4d9f65dc0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:15.284099 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-03ae0e94-b5df-434d-a01a-a4d9f65dc0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.223912 Oct 24 13:15:15.284775 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 193/378] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:15 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:15.352690 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-96b33f97-063c-44c1-9094-8b4bd4b058f1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:15.353422 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-96b33f97-063c-44c1-9094-8b4bd4b058f1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:15.361038 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-96b33f97-063c-44c1-9094-8b4bd4b058f1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:15.362246 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-96b33f97-063c-44c1-9094-8b4bd4b058f1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:15.362992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-96b33f97-063c-44c1-9094-8b4bd4b058f1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:15.363732 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-96b33f97-063c-44c1-9094-8b4bd4b058f1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:15.364187 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-96b33f97-063c-44c1-9094-8b4bd4b058f1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:15.364610 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-96b33f97-063c-44c1-9094-8b4bd4b058f1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:15.557132 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-96b33f97-063c-44c1-9094-8b4bd4b058f1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:15.570092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-96b33f97-063c-44c1-9094-8b4bd4b058f1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1723 microversion: 2.1 time: 0.220973 Oct 24 13:15:15.597586 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 186/379] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:15 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:16.311757 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d4dab9dd-de44-4a7e-80cf-323a78d9669b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:16.312325 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-d4dab9dd-de44-4a7e-80cf-323a78d9669b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:16.318902 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d4dab9dd-de44-4a7e-80cf-323a78d9669b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:16.319641 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d4dab9dd-de44-4a7e-80cf-323a78d9669b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:16.320264 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d4dab9dd-de44-4a7e-80cf-323a78d9669b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:16.320989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d4dab9dd-de44-4a7e-80cf-323a78d9669b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:16.321440 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d4dab9dd-de44-4a7e-80cf-323a78d9669b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:16.321858 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d4dab9dd-de44-4a7e-80cf-323a78d9669b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:16.487248 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-d4dab9dd-de44-4a7e-80cf-323a78d9669b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:16.502541 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-d4dab9dd-de44-4a7e-80cf-323a78d9669b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:16.504156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-d4dab9dd-de44-4a7e-80cf-323a78d9669b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:16.505540 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-d4dab9dd-de44-4a7e-80cf-323a78d9669b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.199417 Oct 24 13:15:16.523955 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 194/380] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:16 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:15:16.605936 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8734fb60-83de-4b8e-90d6-7e3638ff6b34 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:16.606659 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-8734fb60-83de-4b8e-90d6-7e3638ff6b34 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:16.615649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8734fb60-83de-4b8e-90d6-7e3638ff6b34 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:16.616470 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8734fb60-83de-4b8e-90d6-7e3638ff6b34 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:16.617138 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8734fb60-83de-4b8e-90d6-7e3638ff6b34 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:16.618116 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8734fb60-83de-4b8e-90d6-7e3638ff6b34 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:16.618785 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8734fb60-83de-4b8e-90d6-7e3638ff6b34 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:16.619440 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8734fb60-83de-4b8e-90d6-7e3638ff6b34 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:16.818748 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-8734fb60-83de-4b8e-90d6-7e3638ff6b34 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:16.828476 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-8734fb60-83de-4b8e-90d6-7e3638ff6b34 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1723 microversion: 2.1 time: 0.227369 Oct 24 13:15:16.846125 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 187/381] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:16 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:17.535580 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-6e75d4b5-e492-4847-8380-ddf7d6e740f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:17.536381 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-6e75d4b5-e492-4847-8380-ddf7d6e740f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:17.543919 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6e75d4b5-e492-4847-8380-ddf7d6e740f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:17.544495 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6e75d4b5-e492-4847-8380-ddf7d6e740f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:17.544869 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6e75d4b5-e492-4847-8380-ddf7d6e740f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:17.545710 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6e75d4b5-e492-4847-8380-ddf7d6e740f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:17.546205 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6e75d4b5-e492-4847-8380-ddf7d6e740f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:17.546629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6e75d4b5-e492-4847-8380-ddf7d6e740f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:17.734437 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-6e75d4b5-e492-4847-8380-ddf7d6e740f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:17.744460 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-6e75d4b5-e492-4847-8380-ddf7d6e740f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:17.747135 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-6e75d4b5-e492-4847-8380-ddf7d6e740f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:17.749650 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-6e75d4b5-e492-4847-8380-ddf7d6e740f1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.216380 Oct 24 13:15:17.759659 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 195/382] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:17 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:15:17.867371 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-5752b651-dcc6-428f-b3e6-b8a187f98594 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:17.876796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-5752b651-dcc6-428f-b3e6-b8a187f98594 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:17.883033 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:SELECT=64 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:17.896690 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5752b651-dcc6-428f-b3e6-b8a187f98594 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:17.899636 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5752b651-dcc6-428f-b3e6-b8a187f98594 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:17.904833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5752b651-dcc6-428f-b3e6-b8a187f98594 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:17.908815 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5752b651-dcc6-428f-b3e6-b8a187f98594 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:17.911137 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5752b651-dcc6-428f-b3e6-b8a187f98594 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:17.912954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5752b651-dcc6-428f-b3e6-b8a187f98594 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:18.156719 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-5752b651-dcc6-428f-b3e6-b8a187f98594 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:18.166648 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-5752b651-dcc6-428f-b3e6-b8a187f98594 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1723 microversion: 2.1 time: 0.315653 Oct 24 13:15:18.177580 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 188/383] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:17 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1723 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:18.775271 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-07671aba-125e-4665-b201-cb7299c4c8ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:18.777815 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-07671aba-125e-4665-b201-cb7299c4c8ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:18.798742 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-07671aba-125e-4665-b201-cb7299c4c8ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:18.799553 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-07671aba-125e-4665-b201-cb7299c4c8ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:18.800323 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-07671aba-125e-4665-b201-cb7299c4c8ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:18.814963 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-07671aba-125e-4665-b201-cb7299c4c8ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:18.815860 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-07671aba-125e-4665-b201-cb7299c4c8ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:18.816660 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-07671aba-125e-4665-b201-cb7299c4c8ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:19.094252 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-07671aba-125e-4665-b201-cb7299c4c8ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:19.168219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-07671aba-125e-4665-b201-cb7299c4c8ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:19.168219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-07671aba-125e-4665-b201-cb7299c4c8ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:19.168219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-07671aba-125e-4665-b201-cb7299c4c8ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.367778 Oct 24 13:15:19.168637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 196/384] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:18 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:19.200184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9def856d-6a0a-4657-ac01-600eac093f4c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:19.200770 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9def856d-6a0a-4657-ac01-600eac093f4c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:19.208141 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9def856d-6a0a-4657-ac01-600eac093f4c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:19.208636 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9def856d-6a0a-4657-ac01-600eac093f4c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:19.209076 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9def856d-6a0a-4657-ac01-600eac093f4c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:19.210077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9def856d-6a0a-4657-ac01-600eac093f4c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:19.210881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9def856d-6a0a-4657-ac01-600eac093f4c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:19.211469 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9def856d-6a0a-4657-ac01-600eac093f4c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:19.372531 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-9def856d-6a0a-4657-ac01-600eac093f4c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:19.382785 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-9def856d-6a0a-4657-ac01-600eac093f4c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1723 microversion: 2.1 time: 0.186839 Oct 24 13:15:19.400110 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 189/385] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:19 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:20.171104 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c79dfa77-9fd2-4790-9123-4dd70fe0018d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:20.171718 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-c79dfa77-9fd2-4790-9123-4dd70fe0018d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:20.178176 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c79dfa77-9fd2-4790-9123-4dd70fe0018d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:20.178724 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c79dfa77-9fd2-4790-9123-4dd70fe0018d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:20.179196 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c79dfa77-9fd2-4790-9123-4dd70fe0018d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:20.179906 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c79dfa77-9fd2-4790-9123-4dd70fe0018d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:20.180357 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c79dfa77-9fd2-4790-9123-4dd70fe0018d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:20.180799 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c79dfa77-9fd2-4790-9123-4dd70fe0018d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:20.313195 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-c79dfa77-9fd2-4790-9123-4dd70fe0018d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:20.321762 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-c79dfa77-9fd2-4790-9123-4dd70fe0018d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:20.323751 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-c79dfa77-9fd2-4790-9123-4dd70fe0018d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:20.325019 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-c79dfa77-9fd2-4790-9123-4dd70fe0018d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.157845 Oct 24 13:15:20.325565 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 197/386] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:20 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:20.412555 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-fba5844c-e13d-499b-b69c-dd63f31c09b2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:20.413237 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-fba5844c-e13d-499b-b69c-dd63f31c09b2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:20.420162 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fba5844c-e13d-499b-b69c-dd63f31c09b2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:20.420651 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fba5844c-e13d-499b-b69c-dd63f31c09b2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:20.421099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fba5844c-e13d-499b-b69c-dd63f31c09b2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:20.421781 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fba5844c-e13d-499b-b69c-dd63f31c09b2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:20.422828 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fba5844c-e13d-499b-b69c-dd63f31c09b2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:20.423494 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fba5844c-e13d-499b-b69c-dd63f31c09b2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:20.556119 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-fba5844c-e13d-499b-b69c-dd63f31c09b2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:20.565619 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-fba5844c-e13d-499b-b69c-dd63f31c09b2 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1723 microversion: 2.1 time: 0.156878 Oct 24 13:15:20.566172 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 190/387] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:20 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:21.353569 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-6d6add33-61bd-42d1-9619-4e34cd7b36e5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:21.354797 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-6d6add33-61bd-42d1-9619-4e34cd7b36e5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:21.361478 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6d6add33-61bd-42d1-9619-4e34cd7b36e5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:21.361955 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6d6add33-61bd-42d1-9619-4e34cd7b36e5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:21.362445 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6d6add33-61bd-42d1-9619-4e34cd7b36e5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:21.363274 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6d6add33-61bd-42d1-9619-4e34cd7b36e5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:21.363727 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6d6add33-61bd-42d1-9619-4e34cd7b36e5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:21.364142 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6d6add33-61bd-42d1-9619-4e34cd7b36e5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:21.507418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-6d6add33-61bd-42d1-9619-4e34cd7b36e5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:21.516192 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-6d6add33-61bd-42d1-9619-4e34cd7b36e5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:21.517610 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-6d6add33-61bd-42d1-9619-4e34cd7b36e5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:21.518751 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-6d6add33-61bd-42d1-9619-4e34cd7b36e5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.169502 Oct 24 13:15:21.519319 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 198/388] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:21 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:15:21.588447 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-2e2b79eb-6767-48a2-a9f4-0723e8af571f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:21.589063 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-2e2b79eb-6767-48a2-a9f4-0723e8af571f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:21.595701 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2e2b79eb-6767-48a2-a9f4-0723e8af571f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:21.596443 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2e2b79eb-6767-48a2-a9f4-0723e8af571f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:21.596888 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2e2b79eb-6767-48a2-a9f4-0723e8af571f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:21.597581 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2e2b79eb-6767-48a2-a9f4-0723e8af571f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:21.598039 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2e2b79eb-6767-48a2-a9f4-0723e8af571f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:21.598464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2e2b79eb-6767-48a2-a9f4-0723e8af571f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:21.728494 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-2e2b79eb-6767-48a2-a9f4-0723e8af571f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:21.737551 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-2e2b79eb-6767-48a2-a9f4-0723e8af571f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1723 microversion: 2.1 time: 0.152962 Oct 24 13:15:21.738110 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 191/389] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:21 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:15:22.546377 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-83c08364-5b36-4c69-a99f-1a681fb23106 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:22.546982 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-83c08364-5b36-4c69-a99f-1a681fb23106 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:22.553963 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-83c08364-5b36-4c69-a99f-1a681fb23106 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:22.554439 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-83c08364-5b36-4c69-a99f-1a681fb23106 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:22.554869 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-83c08364-5b36-4c69-a99f-1a681fb23106 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:22.555576 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-83c08364-5b36-4c69-a99f-1a681fb23106 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:22.556022 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-83c08364-5b36-4c69-a99f-1a681fb23106 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:22.556441 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-83c08364-5b36-4c69-a99f-1a681fb23106 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:22.762131 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-fadbdcfe-1e42-4d48-9a24-fbcc7f85c513 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:22.762742 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-fadbdcfe-1e42-4d48-9a24-fbcc7f85c513 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:22.769227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fadbdcfe-1e42-4d48-9a24-fbcc7f85c513 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:22.769720 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fadbdcfe-1e42-4d48-9a24-fbcc7f85c513 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:22.770151 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fadbdcfe-1e42-4d48-9a24-fbcc7f85c513 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:22.770841 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fadbdcfe-1e42-4d48-9a24-fbcc7f85c513 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:22.771321 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fadbdcfe-1e42-4d48-9a24-fbcc7f85c513 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:22.771748 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fadbdcfe-1e42-4d48-9a24-fbcc7f85c513 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:22.776307 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-83c08364-5b36-4c69-a99f-1a681fb23106 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:22.786174 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-83c08364-5b36-4c69-a99f-1a681fb23106 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:22.787621 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-83c08364-5b36-4c69-a99f-1a681fb23106 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:22.788976 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-83c08364-5b36-4c69-a99f-1a681fb23106 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.247310 Oct 24 13:15:22.789519 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 199/390] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:22 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:22.910635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-fadbdcfe-1e42-4d48-9a24-fbcc7f85c513 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:22.919830 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-fadbdcfe-1e42-4d48-9a24-fbcc7f85c513 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1723 microversion: 2.1 time: 0.161844 Oct 24 13:15:22.920939 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 192/391] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:22 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:15:23.816916 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-3d95cf1f-51f8-4909-8079-048271d68c80 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:23.817402 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-3d95cf1f-51f8-4909-8079-048271d68c80 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:23.823947 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3d95cf1f-51f8-4909-8079-048271d68c80 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:23.824399 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3d95cf1f-51f8-4909-8079-048271d68c80 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:23.824843 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3d95cf1f-51f8-4909-8079-048271d68c80 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:23.825539 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3d95cf1f-51f8-4909-8079-048271d68c80 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:23.826020 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3d95cf1f-51f8-4909-8079-048271d68c80 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:23.826465 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3d95cf1f-51f8-4909-8079-048271d68c80 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:23.944059 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-e13595bc-6586-4ea2-bdce-e2980bb9ee7d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:23.944679 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-e13595bc-6586-4ea2-bdce-e2980bb9ee7d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:23.951495 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e13595bc-6586-4ea2-bdce-e2980bb9ee7d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:23.951986 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e13595bc-6586-4ea2-bdce-e2980bb9ee7d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:23.952445 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e13595bc-6586-4ea2-bdce-e2980bb9ee7d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:23.953110 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e13595bc-6586-4ea2-bdce-e2980bb9ee7d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:23.953796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e13595bc-6586-4ea2-bdce-e2980bb9ee7d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:23.954227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e13595bc-6586-4ea2-bdce-e2980bb9ee7d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:23.964707 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-3d95cf1f-51f8-4909-8079-048271d68c80 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:23.974119 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-3d95cf1f-51f8-4909-8079-048271d68c80 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:23.980106 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-3d95cf1f-51f8-4909-8079-048271d68c80 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:23.982548 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-3d95cf1f-51f8-4909-8079-048271d68c80 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.169913 Oct 24 13:15:23.983672 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 200/392] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:23 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:24.090973 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-e13595bc-6586-4ea2-bdce-e2980bb9ee7d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:24.099137 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-e13595bc-6586-4ea2-bdce-e2980bb9ee7d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1723 microversion: 2.1 time: 0.159057 Oct 24 13:15:24.099704 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 193/393] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:23 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:15:25.008983 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-374fb3a7-1aea-4aac-9c57-398b59430802 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:25.009592 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-374fb3a7-1aea-4aac-9c57-398b59430802 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:25.017306 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-374fb3a7-1aea-4aac-9c57-398b59430802 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:25.018006 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-374fb3a7-1aea-4aac-9c57-398b59430802 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:25.018753 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-374fb3a7-1aea-4aac-9c57-398b59430802 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:25.019749 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-374fb3a7-1aea-4aac-9c57-398b59430802 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:25.020201 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-374fb3a7-1aea-4aac-9c57-398b59430802 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:25.020802 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-374fb3a7-1aea-4aac-9c57-398b59430802 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:25.123393 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-2e117ad7-bd63-48b5-909d-72781d7a2d14 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:25.124678 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-2e117ad7-bd63-48b5-909d-72781d7a2d14 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:25.132133 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2e117ad7-bd63-48b5-909d-72781d7a2d14 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:25.132984 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2e117ad7-bd63-48b5-909d-72781d7a2d14 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:25.133797 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2e117ad7-bd63-48b5-909d-72781d7a2d14 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:25.134763 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2e117ad7-bd63-48b5-909d-72781d7a2d14 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:25.136360 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2e117ad7-bd63-48b5-909d-72781d7a2d14 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:25.137024 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2e117ad7-bd63-48b5-909d-72781d7a2d14 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:25.169873 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-374fb3a7-1aea-4aac-9c57-398b59430802 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:25.178941 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-374fb3a7-1aea-4aac-9c57-398b59430802 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:25.180424 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-374fb3a7-1aea-4aac-9c57-398b59430802 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:25.181591 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-374fb3a7-1aea-4aac-9c57-398b59430802 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.176841 Oct 24 13:15:25.182218 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 201/394] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:25 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:25.397919 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-2e117ad7-bd63-48b5-909d-72781d7a2d14 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:25.408326 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-2e117ad7-bd63-48b5-909d-72781d7a2d14 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1723 microversion: 2.1 time: 0.288857 Oct 24 13:15:25.409077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 194/395] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:25 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:15:26.207910 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-0e6f5435-aa8c-4759-ae7d-94d846767443 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:26.208585 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-0e6f5435-aa8c-4759-ae7d-94d846767443 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:26.216436 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0e6f5435-aa8c-4759-ae7d-94d846767443 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:26.216926 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0e6f5435-aa8c-4759-ae7d-94d846767443 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:26.217585 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0e6f5435-aa8c-4759-ae7d-94d846767443 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:26.218350 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0e6f5435-aa8c-4759-ae7d-94d846767443 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:26.218814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0e6f5435-aa8c-4759-ae7d-94d846767443 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:26.219278 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0e6f5435-aa8c-4759-ae7d-94d846767443 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:26.238640 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:26.368983 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-0e6f5435-aa8c-4759-ae7d-94d846767443 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:26.380441 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-0e6f5435-aa8c-4759-ae7d-94d846767443 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:26.381886 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-0e6f5435-aa8c-4759-ae7d-94d846767443 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:26.383716 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-0e6f5435-aa8c-4759-ae7d-94d846767443 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.179142 Oct 24 13:15:26.398832 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 202/396] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:26 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:26.431528 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-d3a197e6-323c-433c-a20d-81d3e6249800 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:26.432177 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-d3a197e6-323c-433c-a20d-81d3e6249800 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:26.438883 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d3a197e6-323c-433c-a20d-81d3e6249800 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:26.439417 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d3a197e6-323c-433c-a20d-81d3e6249800 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:26.439860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d3a197e6-323c-433c-a20d-81d3e6249800 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:26.441933 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d3a197e6-323c-433c-a20d-81d3e6249800 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:26.442405 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d3a197e6-323c-433c-a20d-81d3e6249800 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:26.442834 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d3a197e6-323c-433c-a20d-81d3e6249800 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:26.619224 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-d3a197e6-323c-433c-a20d-81d3e6249800 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:26.630968 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-d3a197e6-323c-433c-a20d-81d3e6249800 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1700 microversion: 2.1 time: 0.203219 Oct 24 13:15:26.632119 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 195/397] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:26 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1700 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:26.655609 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-fa5b9291-1400-44b6-90d1-d4e6dfff0d64 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:15:26.662010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa5b9291-1400-44b6-90d1-d4e6dfff0d64 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:26.663172 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa5b9291-1400-44b6-90d1-d4e6dfff0d64 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:26.663807 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa5b9291-1400-44b6-90d1-d4e6dfff0d64 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:26.734259 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-fa5b9291-1400-44b6-90d1-d4e6dfff0d64 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Going to try to start instance {{(pid=118914) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 24 13:15:26.781473 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-fa5b9291-1400-44b6-90d1-d4e6dfff0d64 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "POST /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf/action" status: 202 len: 0 microversion: 2.1 time: 0.130317 Oct 24 13:15:26.785484 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 203/398] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 24 13:15:26 2022] POST /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:15:26.790293 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-06cae1bb-7fcb-4d0c-aad7-e40e63cb2e3b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:26.790911 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-06cae1bb-7fcb-4d0c-aad7-e40e63cb2e3b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:26.797037 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-06cae1bb-7fcb-4d0c-aad7-e40e63cb2e3b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:26.797567 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-06cae1bb-7fcb-4d0c-aad7-e40e63cb2e3b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:26.798199 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-06cae1bb-7fcb-4d0c-aad7-e40e63cb2e3b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:26.798909 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-06cae1bb-7fcb-4d0c-aad7-e40e63cb2e3b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:26.799557 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-06cae1bb-7fcb-4d0c-aad7-e40e63cb2e3b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:26.800153 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-06cae1bb-7fcb-4d0c-aad7-e40e63cb2e3b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:26.940245 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-06cae1bb-7fcb-4d0c-aad7-e40e63cb2e3b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:26.951466 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-06cae1bb-7fcb-4d0c-aad7-e40e63cb2e3b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1709 microversion: 2.1 time: 0.164617 Oct 24 13:15:26.952181 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 196/399] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:26 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1709 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:15:27.412233 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-40b30549-f2b7-4ab5-8812-a8d1c68d5fd1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:27.415758 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-40b30549-f2b7-4ab5-8812-a8d1c68d5fd1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:27.424503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40b30549-f2b7-4ab5-8812-a8d1c68d5fd1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:27.425537 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40b30549-f2b7-4ab5-8812-a8d1c68d5fd1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:27.426209 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40b30549-f2b7-4ab5-8812-a8d1c68d5fd1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:27.427184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40b30549-f2b7-4ab5-8812-a8d1c68d5fd1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:27.428274 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40b30549-f2b7-4ab5-8812-a8d1c68d5fd1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:27.429070 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-40b30549-f2b7-4ab5-8812-a8d1c68d5fd1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:27.679898 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-40b30549-f2b7-4ab5-8812-a8d1c68d5fd1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:27.690603 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-40b30549-f2b7-4ab5-8812-a8d1c68d5fd1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:27.693116 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-40b30549-f2b7-4ab5-8812-a8d1c68d5fd1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:27.694665 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-40b30549-f2b7-4ab5-8812-a8d1c68d5fd1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.288515 Oct 24 13:15:27.695487 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 204/400] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:27 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:27.976008 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-c67ce068-da59-49d2-88a4-587409255c7f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:27.977372 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-c67ce068-da59-49d2-88a4-587409255c7f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:27.984213 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c67ce068-da59-49d2-88a4-587409255c7f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:27.984999 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c67ce068-da59-49d2-88a4-587409255c7f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:27.985967 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c67ce068-da59-49d2-88a4-587409255c7f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:27.986912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c67ce068-da59-49d2-88a4-587409255c7f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:27.987932 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c67ce068-da59-49d2-88a4-587409255c7f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:27.988449 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c67ce068-da59-49d2-88a4-587409255c7f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:28.162919 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-c67ce068-da59-49d2-88a4-587409255c7f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:28.179222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-c67ce068-da59-49d2-88a4-587409255c7f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1709 microversion: 2.1 time: 0.207551 Oct 24 13:15:28.180679 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 197/401] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:27 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1709 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:28.721030 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-2c0ee986-38c4-428b-bae5-b874f5629541 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:28.721741 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-2c0ee986-38c4-428b-bae5-b874f5629541 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:28.728313 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2c0ee986-38c4-428b-bae5-b874f5629541 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:28.729163 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2c0ee986-38c4-428b-bae5-b874f5629541 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:28.729858 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2c0ee986-38c4-428b-bae5-b874f5629541 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:28.730642 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2c0ee986-38c4-428b-bae5-b874f5629541 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:28.731139 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2c0ee986-38c4-428b-bae5-b874f5629541 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:28.731552 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2c0ee986-38c4-428b-bae5-b874f5629541 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:28.893600 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-2c0ee986-38c4-428b-bae5-b874f5629541 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:28.903402 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-2c0ee986-38c4-428b-bae5-b874f5629541 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:28.905035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-2c0ee986-38c4-428b-bae5-b874f5629541 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:28.906208 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-2c0ee986-38c4-428b-bae5-b874f5629541 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.189058 Oct 24 13:15:28.906760 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 205/402] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:28 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:29.205463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-3510ec48-dc2a-45e6-b59a-c443d9f10153 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:29.205943 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-3510ec48-dc2a-45e6-b59a-c443d9f10153 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:29.222392 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3510ec48-dc2a-45e6-b59a-c443d9f10153 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:29.222880 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3510ec48-dc2a-45e6-b59a-c443d9f10153 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:29.227556 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3510ec48-dc2a-45e6-b59a-c443d9f10153 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:29.228308 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3510ec48-dc2a-45e6-b59a-c443d9f10153 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:29.229779 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3510ec48-dc2a-45e6-b59a-c443d9f10153 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:29.230219 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3510ec48-dc2a-45e6-b59a-c443d9f10153 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:29.901602 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-3510ec48-dc2a-45e6-b59a-c443d9f10153 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:29.922808 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-3510ec48-dc2a-45e6-b59a-c443d9f10153 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1709 microversion: 2.1 time: 0.717360 Oct 24 13:15:29.930641 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 198/403] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:29 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1709 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:29.945542 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-362c1031-0482-4378-83bd-9054d361fa9f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:29.946718 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-362c1031-0482-4378-83bd-9054d361fa9f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:29.955250 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-362c1031-0482-4378-83bd-9054d361fa9f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:29.957222 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-362c1031-0482-4378-83bd-9054d361fa9f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:29.959299 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-362c1031-0482-4378-83bd-9054d361fa9f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:29.960848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-362c1031-0482-4378-83bd-9054d361fa9f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:29.962839 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-362c1031-0482-4378-83bd-9054d361fa9f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:29.964011 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-362c1031-0482-4378-83bd-9054d361fa9f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:30.531824 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-362c1031-0482-4378-83bd-9054d361fa9f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:30.541755 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-362c1031-0482-4378-83bd-9054d361fa9f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:30.543679 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-362c1031-0482-4378-83bd-9054d361fa9f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:30.545056 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-362c1031-0482-4378-83bd-9054d361fa9f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.617202 Oct 24 13:15:30.545917 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 206/404] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:29 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:30.955938 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-46a54426-e865-4e40-9f73-491aa356112f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:30.957231 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-46a54426-e865-4e40-9f73-491aa356112f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:30.967461 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-46a54426-e865-4e40-9f73-491aa356112f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:30.968138 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-46a54426-e865-4e40-9f73-491aa356112f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:30.968944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-46a54426-e865-4e40-9f73-491aa356112f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:30.969898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-46a54426-e865-4e40-9f73-491aa356112f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:30.970560 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-46a54426-e865-4e40-9f73-491aa356112f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:30.971234 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-46a54426-e865-4e40-9f73-491aa356112f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:31.164327 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-46a54426-e865-4e40-9f73-491aa356112f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:31.179943 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-46a54426-e865-4e40-9f73-491aa356112f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1709 microversion: 2.1 time: 0.223502 Oct 24 13:15:31.180815 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 199/405] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:30 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1709 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:31.574039 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-f23ed2ca-6d2d-4702-b3ed-922b3e993fba tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:31.574568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-f23ed2ca-6d2d-4702-b3ed-922b3e993fba tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:31.583417 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f23ed2ca-6d2d-4702-b3ed-922b3e993fba tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:31.584660 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f23ed2ca-6d2d-4702-b3ed-922b3e993fba tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:31.585458 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f23ed2ca-6d2d-4702-b3ed-922b3e993fba tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:31.586368 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f23ed2ca-6d2d-4702-b3ed-922b3e993fba tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:31.588656 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f23ed2ca-6d2d-4702-b3ed-922b3e993fba tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:31.589312 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f23ed2ca-6d2d-4702-b3ed-922b3e993fba tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:31.833248 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-f23ed2ca-6d2d-4702-b3ed-922b3e993fba tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:31.849684 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-f23ed2ca-6d2d-4702-b3ed-922b3e993fba tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:31.856613 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-f23ed2ca-6d2d-4702-b3ed-922b3e993fba tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:31.857964 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-f23ed2ca-6d2d-4702-b3ed-922b3e993fba tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.289257 Oct 24 13:15:31.858558 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 207/406] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:31 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:32.208399 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-c9b3958b-dac7-4aaf-8cfe-d7cb8ff41588 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:32.209024 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-c9b3958b-dac7-4aaf-8cfe-d7cb8ff41588 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:32.238941 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c9b3958b-dac7-4aaf-8cfe-d7cb8ff41588 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:32.239765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c9b3958b-dac7-4aaf-8cfe-d7cb8ff41588 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:32.241110 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c9b3958b-dac7-4aaf-8cfe-d7cb8ff41588 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:32.242041 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c9b3958b-dac7-4aaf-8cfe-d7cb8ff41588 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:32.243262 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c9b3958b-dac7-4aaf-8cfe-d7cb8ff41588 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:32.243921 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c9b3958b-dac7-4aaf-8cfe-d7cb8ff41588 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:32.422161 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-c9b3958b-dac7-4aaf-8cfe-d7cb8ff41588 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:32.434519 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-c9b3958b-dac7-4aaf-8cfe-d7cb8ff41588 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1709 microversion: 2.1 time: 0.232600 Oct 24 13:15:32.435572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 200/407] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:32 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1709 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:32.883809 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-223d2faa-2fd0-4100-bc42-d107d347a924 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:32.886175 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-223d2faa-2fd0-4100-bc42-d107d347a924 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:32.903238 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-223d2faa-2fd0-4100-bc42-d107d347a924 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:32.903741 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-223d2faa-2fd0-4100-bc42-d107d347a924 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:32.908827 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-223d2faa-2fd0-4100-bc42-d107d347a924 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:32.915473 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-223d2faa-2fd0-4100-bc42-d107d347a924 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:32.916252 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-223d2faa-2fd0-4100-bc42-d107d347a924 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:32.916706 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-223d2faa-2fd0-4100-bc42-d107d347a924 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:33.439521 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-223d2faa-2fd0-4100-bc42-d107d347a924 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:33.449886 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-223d2faa-2fd0-4100-bc42-d107d347a924 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:33.451383 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-223d2faa-2fd0-4100-bc42-d107d347a924 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:33.457898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-af6ffc88-1aee-40d1-9f3e-a04e4c845e14 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:33.458519 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-af6ffc88-1aee-40d1-9f3e-a04e4c845e14 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:33.462688 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-223d2faa-2fd0-4100-bc42-d107d347a924 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.572701 Oct 24 13:15:33.463457 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 208/408] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:32 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:33.467243 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-af6ffc88-1aee-40d1-9f3e-a04e4c845e14 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:33.467910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-af6ffc88-1aee-40d1-9f3e-a04e4c845e14 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:33.468488 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-af6ffc88-1aee-40d1-9f3e-a04e4c845e14 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:33.469816 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-af6ffc88-1aee-40d1-9f3e-a04e4c845e14 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:33.470419 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-af6ffc88-1aee-40d1-9f3e-a04e4c845e14 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:33.470984 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-af6ffc88-1aee-40d1-9f3e-a04e4c845e14 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:33.475542 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=100 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:33.681120 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-af6ffc88-1aee-40d1-9f3e-a04e4c845e14 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:33.696082 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-af6ffc88-1aee-40d1-9f3e-a04e4c845e14 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1709 microversion: 2.1 time: 0.241473 Oct 24 13:15:33.697946 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 201/409] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:33 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1709 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:34.167781 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-021f71fe-6031-4e19-8361-46c34b2433c0 req-ad64e294-0930-437e-9d31-aac170668bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b5963f-5199-4822-a8c3-20a8ab09224f", "name": "network-vif-plugged", "status": "completed", "tag": "9241fec5-c702-4043-a917-794ed6ca4105"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:15:34.223019 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-021f71fe-6031-4e19-8361-46c34b2433c0 req-ad64e294-0930-437e-9d31-aac170668bb8 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:34.223677 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-021f71fe-6031-4e19-8361-46c34b2433c0 req-ad64e294-0930-437e-9d31-aac170668bb8 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:34.226707 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-021f71fe-6031-4e19-8361-46c34b2433c0 req-ad64e294-0930-437e-9d31-aac170668bb8 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:34.251810 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-021f71fe-6031-4e19-8361-46c34b2433c0 req-ad64e294-0930-437e-9d31-aac170668bb8 service nova] Creating event network-vif-plugged:9241fec5-c702-4043-a917-794ed6ca4105 for instance 27b5963f-5199-4822-a8c3-20a8ab09224f on hv-cinder-86248 Oct 24 13:15:34.257979 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-021f71fe-6031-4e19-8361-46c34b2433c0 req-ad64e294-0930-437e-9d31-aac170668bb8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099263 Oct 24 13:15:34.259329 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 209/410] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:15:34.493552 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-46a65f3b-1ffa-4fa5-9943-fe341493f66f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:34.495215 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-46a65f3b-1ffa-4fa5-9943-fe341493f66f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:34.508455 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-46a65f3b-1ffa-4fa5-9943-fe341493f66f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:34.509231 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-46a65f3b-1ffa-4fa5-9943-fe341493f66f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:34.511367 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-46a65f3b-1ffa-4fa5-9943-fe341493f66f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:34.513517 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-46a65f3b-1ffa-4fa5-9943-fe341493f66f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:34.514557 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-46a65f3b-1ffa-4fa5-9943-fe341493f66f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:34.515383 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-46a65f3b-1ffa-4fa5-9943-fe341493f66f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:34.723676 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-16655191-202c-4084-9cdc-3eda519042f9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:34.728069 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-16655191-202c-4084-9cdc-3eda519042f9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:34.736466 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-16655191-202c-4084-9cdc-3eda519042f9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:34.738296 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-16655191-202c-4084-9cdc-3eda519042f9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:34.738932 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-16655191-202c-4084-9cdc-3eda519042f9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:34.740031 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-16655191-202c-4084-9cdc-3eda519042f9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:34.740673 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-16655191-202c-4084-9cdc-3eda519042f9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:34.741286 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-16655191-202c-4084-9cdc-3eda519042f9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:34.764359 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-46a65f3b-1ffa-4fa5-9943-fe341493f66f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:34.773266 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-46a65f3b-1ffa-4fa5-9943-fe341493f66f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:34.774690 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-46a65f3b-1ffa-4fa5-9943-fe341493f66f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:34.782892 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-46a65f3b-1ffa-4fa5-9943-fe341493f66f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.293863 Oct 24 13:15:34.784660 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 202/411] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:34 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:15:34.936220 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-16655191-202c-4084-9cdc-3eda519042f9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:34.951686 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-16655191-202c-4084-9cdc-3eda519042f9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1713 microversion: 2.1 time: 0.233349 Oct 24 13:15:34.953229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 210/412] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:34 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1713 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:35.809373 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-a849c33e-df26-4f47-8516-97aaa5317e9a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:35.813221 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-a849c33e-df26-4f47-8516-97aaa5317e9a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:35.826452 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a849c33e-df26-4f47-8516-97aaa5317e9a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:35.827490 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a849c33e-df26-4f47-8516-97aaa5317e9a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:35.828169 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a849c33e-df26-4f47-8516-97aaa5317e9a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:35.829259 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a849c33e-df26-4f47-8516-97aaa5317e9a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:35.829928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a849c33e-df26-4f47-8516-97aaa5317e9a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:35.830561 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a849c33e-df26-4f47-8516-97aaa5317e9a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:36.115853 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-a849c33e-df26-4f47-8516-97aaa5317e9a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:36.129886 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-a849c33e-df26-4f47-8516-97aaa5317e9a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:36.131904 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-a849c33e-df26-4f47-8516-97aaa5317e9a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:36.133311 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-a849c33e-df26-4f47-8516-97aaa5317e9a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.328459 Oct 24 13:15:36.147883 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 203/413] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:35 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:37.160799 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-b7564012-c1b8-4795-b2ec-a549e65054ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:37.162146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-b7564012-c1b8-4795-b2ec-a549e65054ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:37.170362 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b7564012-c1b8-4795-b2ec-a549e65054ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:37.170834 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b7564012-c1b8-4795-b2ec-a549e65054ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:37.171511 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b7564012-c1b8-4795-b2ec-a549e65054ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:37.172465 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b7564012-c1b8-4795-b2ec-a549e65054ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:37.173053 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b7564012-c1b8-4795-b2ec-a549e65054ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:37.173622 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b7564012-c1b8-4795-b2ec-a549e65054ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:37.326039 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-b7564012-c1b8-4795-b2ec-a549e65054ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:37.351484 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-b7564012-c1b8-4795-b2ec-a549e65054ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:37.354221 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-b7564012-c1b8-4795-b2ec-a549e65054ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:37.358846 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-b7564012-c1b8-4795-b2ec-a549e65054ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.201718 Oct 24 13:15:37.360034 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 211/414] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:37 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:38.386804 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-e12acc90-dbbd-4aba-8d1b-ffb1ce342d68 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:38.388079 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-e12acc90-dbbd-4aba-8d1b-ffb1ce342d68 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:38.397942 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e12acc90-dbbd-4aba-8d1b-ffb1ce342d68 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:38.398745 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e12acc90-dbbd-4aba-8d1b-ffb1ce342d68 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:38.399542 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e12acc90-dbbd-4aba-8d1b-ffb1ce342d68 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:38.400515 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e12acc90-dbbd-4aba-8d1b-ffb1ce342d68 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:38.401173 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e12acc90-dbbd-4aba-8d1b-ffb1ce342d68 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:38.402087 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e12acc90-dbbd-4aba-8d1b-ffb1ce342d68 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:38.571379 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-e12acc90-dbbd-4aba-8d1b-ffb1ce342d68 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:38.593214 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-e12acc90-dbbd-4aba-8d1b-ffb1ce342d68 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:38.594067 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-e12acc90-dbbd-4aba-8d1b-ffb1ce342d68 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:38.595089 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-e12acc90-dbbd-4aba-8d1b-ffb1ce342d68 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.213570 Oct 24 13:15:38.595685 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 204/415] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:38 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:39.621762 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-5954b4d1-1670-4514-adee-9cfc6a9f7975 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:39.622543 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-5954b4d1-1670-4514-adee-9cfc6a9f7975 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:39.630411 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5954b4d1-1670-4514-adee-9cfc6a9f7975 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:39.631028 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5954b4d1-1670-4514-adee-9cfc6a9f7975 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:39.631586 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5954b4d1-1670-4514-adee-9cfc6a9f7975 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:39.632415 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5954b4d1-1670-4514-adee-9cfc6a9f7975 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:39.632963 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5954b4d1-1670-4514-adee-9cfc6a9f7975 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:39.633628 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5954b4d1-1670-4514-adee-9cfc6a9f7975 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:39.782731 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-5954b4d1-1670-4514-adee-9cfc6a9f7975 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:39.793805 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-5954b4d1-1670-4514-adee-9cfc6a9f7975 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:39.796521 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-5954b4d1-1670-4514-adee-9cfc6a9f7975 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:39.797909 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-5954b4d1-1670-4514-adee-9cfc6a9f7975 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.180482 Oct 24 13:15:39.798952 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 212/416] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:39 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:40.829525 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-78632647-6475-427e-8634-1bc5e2cd5a72 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:40.830921 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-78632647-6475-427e-8634-1bc5e2cd5a72 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:40.837985 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-78632647-6475-427e-8634-1bc5e2cd5a72 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:40.838756 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-78632647-6475-427e-8634-1bc5e2cd5a72 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:40.839385 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-78632647-6475-427e-8634-1bc5e2cd5a72 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:40.840087 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-78632647-6475-427e-8634-1bc5e2cd5a72 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:40.840560 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-78632647-6475-427e-8634-1bc5e2cd5a72 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:40.840974 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-78632647-6475-427e-8634-1bc5e2cd5a72 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:40.976869 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-78632647-6475-427e-8634-1bc5e2cd5a72 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:40.987162 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-78632647-6475-427e-8634-1bc5e2cd5a72 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:40.988666 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-78632647-6475-427e-8634-1bc5e2cd5a72 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:40.990215 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-78632647-6475-427e-8634-1bc5e2cd5a72 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.164587 Oct 24 13:15:40.990797 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 205/417] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:40 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:42.017262 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-5e9f1eda-828b-4843-808f-e55972643d77 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:42.018555 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-5e9f1eda-828b-4843-808f-e55972643d77 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:42.026298 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5e9f1eda-828b-4843-808f-e55972643d77 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:42.027073 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5e9f1eda-828b-4843-808f-e55972643d77 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:42.027658 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5e9f1eda-828b-4843-808f-e55972643d77 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:42.028604 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5e9f1eda-828b-4843-808f-e55972643d77 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:42.029353 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5e9f1eda-828b-4843-808f-e55972643d77 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:42.029923 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5e9f1eda-828b-4843-808f-e55972643d77 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:42.205325 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-5e9f1eda-828b-4843-808f-e55972643d77 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:42.216761 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-5e9f1eda-828b-4843-808f-e55972643d77 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:42.218542 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-5e9f1eda-828b-4843-808f-e55972643d77 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:42.219837 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-5e9f1eda-828b-4843-808f-e55972643d77 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.206377 Oct 24 13:15:42.235880 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 213/418] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:42 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:43.248699 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-3e1c360f-be38-4c55-b10a-2c5999ede479 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:43.249306 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-3e1c360f-be38-4c55-b10a-2c5999ede479 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:43.257532 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3e1c360f-be38-4c55-b10a-2c5999ede479 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:43.258017 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3e1c360f-be38-4c55-b10a-2c5999ede479 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:43.262457 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3e1c360f-be38-4c55-b10a-2c5999ede479 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:43.263455 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3e1c360f-be38-4c55-b10a-2c5999ede479 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:43.265920 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3e1c360f-be38-4c55-b10a-2c5999ede479 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:43.266552 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3e1c360f-be38-4c55-b10a-2c5999ede479 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:43.480592 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-3e1c360f-be38-4c55-b10a-2c5999ede479 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:43.494894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-3e1c360f-be38-4c55-b10a-2c5999ede479 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:43.497043 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-3e1c360f-be38-4c55-b10a-2c5999ede479 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:43.498504 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-3e1c360f-be38-4c55-b10a-2c5999ede479 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1806 microversion: 2.20 time: 0.254228 Oct 24 13:15:43.499469 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 206/419] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:43 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1806 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:15:44.490158 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-8a694f62-ad71-4971-b52b-0050cab937b0 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Action: 'create', calling method: .version_select at 0x7fad2864c1f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-702735127", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3nPfL1J6qnW0+tOxqQZH70LvtRQUpitnXUmCAcfsKK6UDD8dP6pRcZE1qdvgyTrYjxu7Z2Pf2EIUXf4Ls9yMCJH70FYgv5sXF1yKkoadewxPRBKJQK2atJlex+ZGyEug=="}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:15:44.505869 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-8a694f62-ad71-4971-b52b-0050cab937b0 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Getting quotas for project e6ab0fbf44394afda8dd8f49818ccc63. Resources: {'key_pairs'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:15:44.510919 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-8a694f62-ad71-4971-b52b-0050cab937b0 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Getting quotas for user a769bcc0330a4171948a3cc930bd1ee2 and project e6ab0fbf44394afda8dd8f49818ccc63. Resources: {'key_pairs'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:15:44.522841 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8a694f62-ad71-4971-b52b-0050cab937b0 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [3b597e3c-9d0b-455a-b514-6a900e6099ea] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 13:15:44.524256 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-643af00c-5327-40e2-8287-d9ee38c172f7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:44.524861 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-643af00c-5327-40e2-8287-d9ee38c172f7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:44.531266 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-643af00c-5327-40e2-8287-d9ee38c172f7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:44.531747 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-643af00c-5327-40e2-8287-d9ee38c172f7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:44.532179 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-643af00c-5327-40e2-8287-d9ee38c172f7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:44.532865 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-643af00c-5327-40e2-8287-d9ee38c172f7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:44.533343 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-643af00c-5327-40e2-8287-d9ee38c172f7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:44.533764 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-643af00c-5327-40e2-8287-d9ee38c172f7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:44.669298 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-643af00c-5327-40e2-8287-d9ee38c172f7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:44.677800 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-643af00c-5327-40e2-8287-d9ee38c172f7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:44.679267 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-643af00c-5327-40e2-8287-d9ee38c172f7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:44.680472 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-643af00c-5327-40e2-8287-d9ee38c172f7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1793 microversion: 2.20 time: 0.160133 Oct 24 13:15:44.681224 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 207/420] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:15:44 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1793 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:15:45.530676 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO oslo.messaging._drivers.impl_rabbit [None req-8a694f62-ad71-4971-b52b-0050cab937b0 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [3b597e3c-9d0b-455a-b514-6a900e6099ea] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 36904. Oct 24 13:15:45.539094 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=52 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:45.549185 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-8a694f62-ad71-4971-b52b-0050cab937b0 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.062897 Oct 24 13:15:45.555286 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 214/421] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Oct 24 13:15:44 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:15:45.607132 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-ee5547b3-3079-4d2c-90bd-84e1dc608f7a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-343147776", "imageRef": "b9cdb039-9489-4fb8-8131-3a319700c103", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-702735127", "networks": [{"uuid": "4279f750-abb3-4f71-b284-28a4618e7809"}]}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:15:45.662178 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.network.neutron [None req-ee5547b3-3079-4d2c-90bd-84e1dc608f7a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] validate_networks() for [('4279f750-abb3-4f71-b284-28a4618e7809', None, None, None, None, None)] {{(pid=118915) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:15:46.043935 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-ee5547b3-3079-4d2c-90bd-84e1dc608f7a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Flavor limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:15:46.044351 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-ee5547b3-3079-4d2c-90bd-84e1dc608f7a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Image limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:15:46.044815 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-ee5547b3-3079-4d2c-90bd-84e1dc608f7a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Flavor pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:15:46.045217 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-ee5547b3-3079-4d2c-90bd-84e1dc608f7a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Image pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:15:46.045621 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-ee5547b3-3079-4d2c-90bd-84e1dc608f7a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:15:46.054187 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ee5547b3-3079-4d2c-90bd-84e1dc608f7a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:46.054658 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ee5547b3-3079-4d2c-90bd-84e1dc608f7a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:46.055143 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ee5547b3-3079-4d2c-90bd-84e1dc608f7a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:46.055855 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ee5547b3-3079-4d2c-90bd-84e1dc608f7a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:46.056904 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ee5547b3-3079-4d2c-90bd-84e1dc608f7a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:46.057817 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ee5547b3-3079-4d2c-90bd-84e1dc608f7a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:46.075344 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-ee5547b3-3079-4d2c-90bd-84e1dc608f7a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Getting quotas for project e6ab0fbf44394afda8dd8f49818ccc63. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:15:46.079348 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-ee5547b3-3079-4d2c-90bd-84e1dc608f7a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Getting quotas for user a769bcc0330a4171948a3cc930bd1ee2 and project e6ab0fbf44394afda8dd8f49818ccc63. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:15:46.090436 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-ee5547b3-3079-4d2c-90bd-84e1dc608f7a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Going to run 1 instances... {{(pid=118915) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:15:46.092920 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-ee5547b3-3079-4d2c-90bd-84e1dc608f7a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b9cdb039-9489-4fb8-8131-3a319700c103',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:15:46.140359 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-ee5547b3-3079-4d2c-90bd-84e1dc608f7a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538018 Oct 24 13:15:46.141003 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 208/422] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 24 13:15:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:15:46.152146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-90eef0c5-ff4d-405c-9725-a7955124c0ec tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:46.152837 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-90eef0c5-ff4d-405c-9725-a7955124c0ec tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:46.207939 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-90eef0c5-ff4d-405c-9725-a7955124c0ec tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:46.214822 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-90eef0c5-ff4d-405c-9725-a7955124c0ec tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1257 microversion: 2.1 time: 0.066663 Oct 24 13:15:46.215406 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 215/423] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:46 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:15:46.596193 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-6dfba371-95c7-46b7-8aa7-a0d2e0412f75 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:46.596765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-6dfba371-95c7-46b7-8aa7-a0d2e0412f75 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:46.602944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6dfba371-95c7-46b7-8aa7-a0d2e0412f75 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:46.604295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6dfba371-95c7-46b7-8aa7-a0d2e0412f75 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:46.604804 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6dfba371-95c7-46b7-8aa7-a0d2e0412f75 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:46.605616 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6dfba371-95c7-46b7-8aa7-a0d2e0412f75 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:46.606138 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6dfba371-95c7-46b7-8aa7-a0d2e0412f75 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:46.606624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6dfba371-95c7-46b7-8aa7-a0d2e0412f75 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:46.736367 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.objects.instance [None req-6dfba371-95c7-46b7-8aa7-a0d2e0412f75 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lazy-loading 'services' on Instance uuid 24354cc9-2856-455f-b89e-cd913ef97dde {{(pid=118915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:15:46.856495 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-6dfba371-95c7-46b7-8aa7-a0d2e0412f75 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "DELETE /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde/os-volume_attachments/614fc30e-9c85-44d4-9b6b-a12da71d73c4" status: 202 len: 0 microversion: 2.1 time: 0.265058 Oct 24 13:15:46.857188 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 209/424] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 24 13:15:46 2022] DELETE /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde/os-volume_attachments/614fc30e-9c85-44d4-9b6b-a12da71d73c4 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:15:47.238180 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-00343275-5d93-4cf1-86af-459e9eb24b02 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:47.238824 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-00343275-5d93-4cf1-86af-459e9eb24b02 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:47.246277 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-00343275-5d93-4cf1-86af-459e9eb24b02 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:47.246763 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-00343275-5d93-4cf1-86af-459e9eb24b02 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:47.247226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-00343275-5d93-4cf1-86af-459e9eb24b02 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:47.247923 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-00343275-5d93-4cf1-86af-459e9eb24b02 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:47.248378 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-00343275-5d93-4cf1-86af-459e9eb24b02 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:47.248802 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-00343275-5d93-4cf1-86af-459e9eb24b02 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:47.313575 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-00343275-5d93-4cf1-86af-459e9eb24b02 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:47.321208 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-00343275-5d93-4cf1-86af-459e9eb24b02 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1309 microversion: 2.1 time: 0.087001 Oct 24 13:15:47.321760 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 216/425] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:47 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1309 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:48.346603 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-3fd82631-a8ee-46df-a9e0-592e6aaa18c1 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:48.347428 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-3fd82631-a8ee-46df-a9e0-592e6aaa18c1 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:48.349476 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:48.367800 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3fd82631-a8ee-46df-a9e0-592e6aaa18c1 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:48.368391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3fd82631-a8ee-46df-a9e0-592e6aaa18c1 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:48.368963 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3fd82631-a8ee-46df-a9e0-592e6aaa18c1 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:48.369859 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3fd82631-a8ee-46df-a9e0-592e6aaa18c1 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:48.370420 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3fd82631-a8ee-46df-a9e0-592e6aaa18c1 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:48.370973 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3fd82631-a8ee-46df-a9e0-592e6aaa18c1 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:48.514119 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-3fd82631-a8ee-46df-a9e0-592e6aaa18c1 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:48.523378 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-3fd82631-a8ee-46df-a9e0-592e6aaa18c1 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1315 microversion: 2.1 time: 0.181333 Oct 24 13:15:48.523944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 210/426] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:48 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:49.074691 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-19ebdd19-efcd-4d10-b973-bff7ef61d89b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:49.075205 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-19ebdd19-efcd-4d10-b973-bff7ef61d89b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:49.081696 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19ebdd19-efcd-4d10-b973-bff7ef61d89b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:49.082176 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19ebdd19-efcd-4d10-b973-bff7ef61d89b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:49.082612 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19ebdd19-efcd-4d10-b973-bff7ef61d89b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:49.083336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19ebdd19-efcd-4d10-b973-bff7ef61d89b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:49.083792 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19ebdd19-efcd-4d10-b973-bff7ef61d89b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:49.084212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19ebdd19-efcd-4d10-b973-bff7ef61d89b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:49.112127 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-19ebdd19-efcd-4d10-b973-bff7ef61d89b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Going to try to terminate instance {{(pid=118914) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:15:49.193506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-19ebdd19-efcd-4d10-b973-bff7ef61d89b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "DELETE /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 204 len: 0 microversion: 2.1 time: 0.123188 Oct 24 13:15:49.194102 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 217/427] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:15:49 2022] DELETE /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:15:49.203195 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-780740ab-fada-47ed-be28-e701e56e18a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:49.203803 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-780740ab-fada-47ed-be28-e701e56e18a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:49.209847 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-780740ab-fada-47ed-be28-e701e56e18a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:49.210309 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-780740ab-fada-47ed-be28-e701e56e18a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:49.210742 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-780740ab-fada-47ed-be28-e701e56e18a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:49.211502 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-780740ab-fada-47ed-be28-e701e56e18a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:49.211954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-780740ab-fada-47ed-be28-e701e56e18a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:49.212379 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-780740ab-fada-47ed-be28-e701e56e18a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:49.352536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-780740ab-fada-47ed-be28-e701e56e18a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:49.360671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-780740ab-fada-47ed-be28-e701e56e18a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1513 microversion: 2.1 time: 0.161284 Oct 24 13:15:49.361245 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 211/428] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:49 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:49.551949 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-8f27f4d4-e49e-4853-81f7-0f8664ed8690 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:49.552648 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-8f27f4d4-e49e-4853-81f7-0f8664ed8690 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:49.559809 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8f27f4d4-e49e-4853-81f7-0f8664ed8690 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:49.560297 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8f27f4d4-e49e-4853-81f7-0f8664ed8690 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:49.560732 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8f27f4d4-e49e-4853-81f7-0f8664ed8690 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:49.561426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8f27f4d4-e49e-4853-81f7-0f8664ed8690 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:49.561885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8f27f4d4-e49e-4853-81f7-0f8664ed8690 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:49.562304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8f27f4d4-e49e-4853-81f7-0f8664ed8690 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:49.717095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-8f27f4d4-e49e-4853-81f7-0f8664ed8690 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:49.725133 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-8f27f4d4-e49e-4853-81f7-0f8664ed8690 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1357 microversion: 2.1 time: 0.177420 Oct 24 13:15:49.725703 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 218/429] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:49 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:50.383723 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9288aeca-47cf-4e88-b891-8eb586157b1f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:50.385933 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9288aeca-47cf-4e88-b891-8eb586157b1f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:50.393118 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9288aeca-47cf-4e88-b891-8eb586157b1f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:50.393599 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9288aeca-47cf-4e88-b891-8eb586157b1f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:50.394033 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9288aeca-47cf-4e88-b891-8eb586157b1f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:50.394760 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9288aeca-47cf-4e88-b891-8eb586157b1f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:50.395295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9288aeca-47cf-4e88-b891-8eb586157b1f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:50.395713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9288aeca-47cf-4e88-b891-8eb586157b1f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:50.531997 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-9288aeca-47cf-4e88-b891-8eb586157b1f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:50.539793 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-9288aeca-47cf-4e88-b891-8eb586157b1f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1513 microversion: 2.1 time: 0.159876 Oct 24 13:15:50.540358 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 212/430] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:50 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:50.750489 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-cf44c4c6-998e-4484-9134-4463532af288 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:50.751308 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-cf44c4c6-998e-4484-9134-4463532af288 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:50.758103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cf44c4c6-998e-4484-9134-4463532af288 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:50.758670 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cf44c4c6-998e-4484-9134-4463532af288 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:50.759604 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cf44c4c6-998e-4484-9134-4463532af288 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:50.761048 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cf44c4c6-998e-4484-9134-4463532af288 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:50.761501 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cf44c4c6-998e-4484-9134-4463532af288 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:50.761926 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cf44c4c6-998e-4484-9134-4463532af288 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:50.766142 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:50.895235 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-cf44c4c6-998e-4484-9134-4463532af288 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:50.902928 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-cf44c4c6-998e-4484-9134-4463532af288 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1357 microversion: 2.1 time: 0.156253 Oct 24 13:15:50.903530 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 219/431] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:50 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:51.564098 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-c7d9a4c4-76e6-4226-8144-edbc9a6b8a2c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:51.564693 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-c7d9a4c4-76e6-4226-8144-edbc9a6b8a2c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:51.571100 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c7d9a4c4-76e6-4226-8144-edbc9a6b8a2c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:51.571583 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c7d9a4c4-76e6-4226-8144-edbc9a6b8a2c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:51.572570 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c7d9a4c4-76e6-4226-8144-edbc9a6b8a2c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:51.573278 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c7d9a4c4-76e6-4226-8144-edbc9a6b8a2c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:51.573704 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c7d9a4c4-76e6-4226-8144-edbc9a6b8a2c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:51.574129 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c7d9a4c4-76e6-4226-8144-edbc9a6b8a2c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:51.712233 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-c7d9a4c4-76e6-4226-8144-edbc9a6b8a2c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:51.720091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-c7d9a4c4-76e6-4226-8144-edbc9a6b8a2c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1513 microversion: 2.1 time: 0.159974 Oct 24 13:15:51.720665 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 213/432] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:51 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:51.930716 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-8a4ffdf1-13f6-49e6-99ac-d3fbb461a29c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:51.932096 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-8a4ffdf1-13f6-49e6-99ac-d3fbb461a29c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:51.938892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8a4ffdf1-13f6-49e6-99ac-d3fbb461a29c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:51.939468 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8a4ffdf1-13f6-49e6-99ac-d3fbb461a29c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:51.940018 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8a4ffdf1-13f6-49e6-99ac-d3fbb461a29c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:51.940768 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8a4ffdf1-13f6-49e6-99ac-d3fbb461a29c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:51.941285 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8a4ffdf1-13f6-49e6-99ac-d3fbb461a29c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:51.941774 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8a4ffdf1-13f6-49e6-99ac-d3fbb461a29c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:52.076976 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-8a4ffdf1-13f6-49e6-99ac-d3fbb461a29c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:52.085206 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-8a4ffdf1-13f6-49e6-99ac-d3fbb461a29c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1357 microversion: 2.1 time: 0.158458 Oct 24 13:15:52.085779 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 220/433] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:51 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:52.743377 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-56a6e9a1-f00d-4170-9762-4b07a4119f8d tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:52.744931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-56a6e9a1-f00d-4170-9762-4b07a4119f8d tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:52.751507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-56a6e9a1-f00d-4170-9762-4b07a4119f8d tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:52.751985 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-56a6e9a1-f00d-4170-9762-4b07a4119f8d tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:52.752424 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-56a6e9a1-f00d-4170-9762-4b07a4119f8d tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:52.753118 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-56a6e9a1-f00d-4170-9762-4b07a4119f8d tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:52.753571 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-56a6e9a1-f00d-4170-9762-4b07a4119f8d tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:52.754018 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-56a6e9a1-f00d-4170-9762-4b07a4119f8d tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:52.889135 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-56a6e9a1-f00d-4170-9762-4b07a4119f8d tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:52.896896 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-56a6e9a1-f00d-4170-9762-4b07a4119f8d tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1513 microversion: 2.1 time: 0.157378 Oct 24 13:15:52.897464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 214/434] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:52 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:53.109138 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-1a1ba1b8-6898-4ab5-b103-d43ceac87d37 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:53.109803 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-1a1ba1b8-6898-4ab5-b103-d43ceac87d37 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:53.116334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1a1ba1b8-6898-4ab5-b103-d43ceac87d37 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:53.116819 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1a1ba1b8-6898-4ab5-b103-d43ceac87d37 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:53.117253 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1a1ba1b8-6898-4ab5-b103-d43ceac87d37 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:53.118103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1a1ba1b8-6898-4ab5-b103-d43ceac87d37 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:53.118557 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1a1ba1b8-6898-4ab5-b103-d43ceac87d37 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:53.119219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1a1ba1b8-6898-4ab5-b103-d43ceac87d37 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:53.258197 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-1a1ba1b8-6898-4ab5-b103-d43ceac87d37 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:53.267238 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-1a1ba1b8-6898-4ab5-b103-d43ceac87d37 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1357 microversion: 2.1 time: 0.162255 Oct 24 13:15:53.267797 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 221/435] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:53 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:15:53.921548 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-1f42686d-5064-4be6-9e5e-a9ad1c40d26f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:53.922148 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-1f42686d-5064-4be6-9e5e-a9ad1c40d26f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:53.933244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1f42686d-5064-4be6-9e5e-a9ad1c40d26f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:53.934120 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1f42686d-5064-4be6-9e5e-a9ad1c40d26f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:53.934857 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1f42686d-5064-4be6-9e5e-a9ad1c40d26f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:53.935893 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1f42686d-5064-4be6-9e5e-a9ad1c40d26f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:53.936385 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1f42686d-5064-4be6-9e5e-a9ad1c40d26f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:53.936788 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1f42686d-5064-4be6-9e5e-a9ad1c40d26f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:54.072622 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-1f42686d-5064-4be6-9e5e-a9ad1c40d26f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:54.080839 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-1f42686d-5064-4be6-9e5e-a9ad1c40d26f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1513 microversion: 2.1 time: 0.163075 Oct 24 13:15:54.081604 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 215/436] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:53 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:54.292210 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d1aca0e0-a14e-4861-86e2-baca500fce96 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:54.292826 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-d1aca0e0-a14e-4861-86e2-baca500fce96 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:54.299368 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d1aca0e0-a14e-4861-86e2-baca500fce96 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:54.299853 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d1aca0e0-a14e-4861-86e2-baca500fce96 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:54.300287 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d1aca0e0-a14e-4861-86e2-baca500fce96 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:54.300979 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d1aca0e0-a14e-4861-86e2-baca500fce96 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:54.301429 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d1aca0e0-a14e-4861-86e2-baca500fce96 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:54.301849 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d1aca0e0-a14e-4861-86e2-baca500fce96 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:54.436518 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-d1aca0e0-a14e-4861-86e2-baca500fce96 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:54.444166 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-d1aca0e0-a14e-4861-86e2-baca500fce96 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1357 microversion: 2.1 time: 0.155925 Oct 24 13:15:54.445000 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 222/437] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:54 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:55.104240 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-073c61e1-a33a-4882-b8f2-7e5947de01e6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:55.104945 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-073c61e1-a33a-4882-b8f2-7e5947de01e6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:55.111796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-073c61e1-a33a-4882-b8f2-7e5947de01e6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:55.112275 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-073c61e1-a33a-4882-b8f2-7e5947de01e6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:55.112702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-073c61e1-a33a-4882-b8f2-7e5947de01e6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:55.113394 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-073c61e1-a33a-4882-b8f2-7e5947de01e6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:55.113842 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-073c61e1-a33a-4882-b8f2-7e5947de01e6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:55.114259 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-073c61e1-a33a-4882-b8f2-7e5947de01e6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:55.252085 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-073c61e1-a33a-4882-b8f2-7e5947de01e6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:55.260231 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-073c61e1-a33a-4882-b8f2-7e5947de01e6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1513 microversion: 2.1 time: 0.160540 Oct 24 13:15:55.261272 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 216/438] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:55 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:55.469967 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-295e82d5-f6cf-4704-bb53-1c4064aacba0 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:55.471040 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-295e82d5-f6cf-4704-bb53-1c4064aacba0 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:55.481136 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-295e82d5-f6cf-4704-bb53-1c4064aacba0 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:55.482210 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-295e82d5-f6cf-4704-bb53-1c4064aacba0 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:55.482588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-295e82d5-f6cf-4704-bb53-1c4064aacba0 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:55.483554 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-295e82d5-f6cf-4704-bb53-1c4064aacba0 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:55.484172 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-295e82d5-f6cf-4704-bb53-1c4064aacba0 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:55.484805 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-295e82d5-f6cf-4704-bb53-1c4064aacba0 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:55.664662 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-295e82d5-f6cf-4704-bb53-1c4064aacba0 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:55.673156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-295e82d5-f6cf-4704-bb53-1c4064aacba0 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1357 microversion: 2.1 time: 0.209216 Oct 24 13:15:55.673932 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 223/439] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:55 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1357 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:56.284502 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-a79c0412-b9e4-4541-97de-ad63413864ab tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:56.285109 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-a79c0412-b9e4-4541-97de-ad63413864ab tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:56.286947 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=2 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:56.287705 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=6 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:56.295343 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a79c0412-b9e4-4541-97de-ad63413864ab tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:56.295827 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a79c0412-b9e4-4541-97de-ad63413864ab tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:56.296258 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a79c0412-b9e4-4541-97de-ad63413864ab tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:56.296949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a79c0412-b9e4-4541-97de-ad63413864ab tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:56.297388 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a79c0412-b9e4-4541-97de-ad63413864ab tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:56.297798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a79c0412-b9e4-4541-97de-ad63413864ab tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:56.430950 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-a79c0412-b9e4-4541-97de-ad63413864ab tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:56.433331 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:56.440560 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-a79c0412-b9e4-4541-97de-ad63413864ab tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1513 microversion: 2.1 time: 0.160287 Oct 24 13:15:56.441133 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 217/440] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:56 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:56.698285 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-fcd29d9d-030e-4f56-858f-00c4dbde1a5b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:56.699027 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-fcd29d9d-030e-4f56-858f-00c4dbde1a5b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:56.702272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=6 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:15:56.707009 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fcd29d9d-030e-4f56-858f-00c4dbde1a5b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:56.707526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fcd29d9d-030e-4f56-858f-00c4dbde1a5b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:56.707977 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fcd29d9d-030e-4f56-858f-00c4dbde1a5b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:56.708691 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fcd29d9d-030e-4f56-858f-00c4dbde1a5b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:56.709141 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fcd29d9d-030e-4f56-858f-00c4dbde1a5b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:56.709562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fcd29d9d-030e-4f56-858f-00c4dbde1a5b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:56.841853 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-fcd29d9d-030e-4f56-858f-00c4dbde1a5b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:56.850074 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-fcd29d9d-030e-4f56-858f-00c4dbde1a5b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1357 microversion: 2.1 time: 0.156161 Oct 24 13:15:56.850864 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 224/441] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:56 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:57.463448 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-0552a250-ae13-4890-9367-c985a07291c7 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:57.464084 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-0552a250-ae13-4890-9367-c985a07291c7 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:57.471024 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0552a250-ae13-4890-9367-c985a07291c7 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:57.471529 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0552a250-ae13-4890-9367-c985a07291c7 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:57.471973 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0552a250-ae13-4890-9367-c985a07291c7 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:57.472699 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0552a250-ae13-4890-9367-c985a07291c7 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:57.473151 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0552a250-ae13-4890-9367-c985a07291c7 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:57.473572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0552a250-ae13-4890-9367-c985a07291c7 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:57.610652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-0552a250-ae13-4890-9367-c985a07291c7 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:57.618692 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-0552a250-ae13-4890-9367-c985a07291c7 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1513 microversion: 2.1 time: 0.159464 Oct 24 13:15:57.619814 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 218/442] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:57 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:57.872358 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c6ccbb2d-e68f-4b72-a424-69669b7c6371 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:57.873028 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-c6ccbb2d-e68f-4b72-a424-69669b7c6371 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:57.879498 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c6ccbb2d-e68f-4b72-a424-69669b7c6371 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:57.879975 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c6ccbb2d-e68f-4b72-a424-69669b7c6371 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:57.880401 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c6ccbb2d-e68f-4b72-a424-69669b7c6371 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:57.881087 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c6ccbb2d-e68f-4b72-a424-69669b7c6371 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:57.881531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c6ccbb2d-e68f-4b72-a424-69669b7c6371 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:57.881945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c6ccbb2d-e68f-4b72-a424-69669b7c6371 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:58.012606 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-c6ccbb2d-e68f-4b72-a424-69669b7c6371 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:58.021338 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-c6ccbb2d-e68f-4b72-a424-69669b7c6371 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1357 microversion: 2.1 time: 0.152758 Oct 24 13:15:58.022103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 225/443] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:57 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:58.642067 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-4fe45349-e3f1-4ac3-a0b7-0f2d51bfa0fb tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:58.642835 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-4fe45349-e3f1-4ac3-a0b7-0f2d51bfa0fb tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:58.649364 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4fe45349-e3f1-4ac3-a0b7-0f2d51bfa0fb tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:58.649839 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4fe45349-e3f1-4ac3-a0b7-0f2d51bfa0fb tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:58.650514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4fe45349-e3f1-4ac3-a0b7-0f2d51bfa0fb tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:58.651456 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4fe45349-e3f1-4ac3-a0b7-0f2d51bfa0fb tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:58.651907 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4fe45349-e3f1-4ac3-a0b7-0f2d51bfa0fb tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:58.652325 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4fe45349-e3f1-4ac3-a0b7-0f2d51bfa0fb tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:58.789986 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-4fe45349-e3f1-4ac3-a0b7-0f2d51bfa0fb tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:58.797838 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-4fe45349-e3f1-4ac3-a0b7-0f2d51bfa0fb tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1513 microversion: 2.1 time: 0.159619 Oct 24 13:15:58.798403 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 219/444] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:58 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:59.045043 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-9398b0e2-8854-4c2b-899d-92a780fe40c5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:59.045765 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-9398b0e2-8854-4c2b-899d-92a780fe40c5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:59.052651 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9398b0e2-8854-4c2b-899d-92a780fe40c5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:59.053146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9398b0e2-8854-4c2b-899d-92a780fe40c5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:59.053668 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9398b0e2-8854-4c2b-899d-92a780fe40c5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:59.054272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9398b0e2-8854-4c2b-899d-92a780fe40c5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:59.054720 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9398b0e2-8854-4c2b-899d-92a780fe40c5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:59.055169 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9398b0e2-8854-4c2b-899d-92a780fe40c5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:59.192845 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-9398b0e2-8854-4c2b-899d-92a780fe40c5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:59.200702 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-9398b0e2-8854-4c2b-899d-92a780fe40c5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1357 microversion: 2.1 time: 0.160133 Oct 24 13:15:59.202075 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 226/445] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:59 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:15:59.822122 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-6370a5cc-ce3f-4c8b-be3f-aae030cc2471 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:15:59.823370 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-6370a5cc-ce3f-4c8b-be3f-aae030cc2471 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:15:59.829815 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6370a5cc-ce3f-4c8b-be3f-aae030cc2471 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:59.830296 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6370a5cc-ce3f-4c8b-be3f-aae030cc2471 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:59.830726 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6370a5cc-ce3f-4c8b-be3f-aae030cc2471 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:59.831448 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6370a5cc-ce3f-4c8b-be3f-aae030cc2471 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:15:59.831896 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6370a5cc-ce3f-4c8b-be3f-aae030cc2471 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:15:59.832316 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6370a5cc-ce3f-4c8b-be3f-aae030cc2471 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:15:59.981329 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-6370a5cc-ce3f-4c8b-be3f-aae030cc2471 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:15:59.989147 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-6370a5cc-ce3f-4c8b-be3f-aae030cc2471 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1513 microversion: 2.1 time: 0.171499 Oct 24 13:15:59.989727 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 220/446] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:15:59 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:00.224850 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-8510f68f-53db-45ad-95eb-3610916900d6 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:00.225480 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-8510f68f-53db-45ad-95eb-3610916900d6 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:00.232307 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8510f68f-53db-45ad-95eb-3610916900d6 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:00.232730 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8510f68f-53db-45ad-95eb-3610916900d6 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:00.233169 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8510f68f-53db-45ad-95eb-3610916900d6 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:00.233878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8510f68f-53db-45ad-95eb-3610916900d6 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:00.234335 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8510f68f-53db-45ad-95eb-3610916900d6 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:00.234764 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8510f68f-53db-45ad-95eb-3610916900d6 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:00.367538 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-8510f68f-53db-45ad-95eb-3610916900d6 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:00.376736 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-8510f68f-53db-45ad-95eb-3610916900d6 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1357 microversion: 2.1 time: 0.156017 Oct 24 13:16:00.377306 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 227/447] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:00 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:01.014022 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-27cf540b-0fa7-40fe-985f-29d22d34cfa1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:01.015207 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-27cf540b-0fa7-40fe-985f-29d22d34cfa1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:01.021603 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-27cf540b-0fa7-40fe-985f-29d22d34cfa1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:01.022073 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-27cf540b-0fa7-40fe-985f-29d22d34cfa1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:01.022499 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-27cf540b-0fa7-40fe-985f-29d22d34cfa1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:01.023233 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-27cf540b-0fa7-40fe-985f-29d22d34cfa1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:01.023680 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-27cf540b-0fa7-40fe-985f-29d22d34cfa1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:01.024096 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-27cf540b-0fa7-40fe-985f-29d22d34cfa1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:01.235422 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-27cf540b-0fa7-40fe-985f-29d22d34cfa1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:01.242980 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-27cf540b-0fa7-40fe-985f-29d22d34cfa1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1513 microversion: 2.1 time: 0.233100 Oct 24 13:16:01.243580 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 221/448] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:01 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:01.401525 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-0740f885-c1ac-43b3-b0c0-96721dec4222 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:01.402269 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-0740f885-c1ac-43b3-b0c0-96721dec4222 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:01.408654 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0740f885-c1ac-43b3-b0c0-96721dec4222 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:01.409132 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0740f885-c1ac-43b3-b0c0-96721dec4222 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:01.409556 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0740f885-c1ac-43b3-b0c0-96721dec4222 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:01.410241 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0740f885-c1ac-43b3-b0c0-96721dec4222 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:01.410692 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0740f885-c1ac-43b3-b0c0-96721dec4222 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:01.411138 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0740f885-c1ac-43b3-b0c0-96721dec4222 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:01.544651 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-0740f885-c1ac-43b3-b0c0-96721dec4222 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:01.552298 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-0740f885-c1ac-43b3-b0c0-96721dec4222 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1357 microversion: 2.1 time: 0.155738 Oct 24 13:16:01.552869 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 228/449] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:01 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:01.599035 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-5ea00cb7-788e-4afe-bc47-f6a3bb9e6cf3 req-2878508d-440c-47ea-9f91-9fe8c973a33d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5633650-dcf9-49be-b565-3e8fb5a765f4", "tag": "018f2d3e-909b-488a-af88-b11609f2409d"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:01.608399 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-5ea00cb7-788e-4afe-bc47-f6a3bb9e6cf3 req-2878508d-440c-47ea-9f91-9fe8c973a33d service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:01.608873 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-5ea00cb7-788e-4afe-bc47-f6a3bb9e6cf3 req-2878508d-440c-47ea-9f91-9fe8c973a33d service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:01.609357 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-5ea00cb7-788e-4afe-bc47-f6a3bb9e6cf3 req-2878508d-440c-47ea-9f91-9fe8c973a33d service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:01.621058 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-5ea00cb7-788e-4afe-bc47-f6a3bb9e6cf3 req-2878508d-440c-47ea-9f91-9fe8c973a33d service nova] Creating event network-changed:018f2d3e-909b-488a-af88-b11609f2409d for instance e5633650-dcf9-49be-b565-3e8fb5a765f4 on hv-cinder-86248 Oct 24 13:16:01.625889 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-5ea00cb7-788e-4afe-bc47-f6a3bb9e6cf3 req-2878508d-440c-47ea-9f91-9fe8c973a33d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030483 Oct 24 13:16:01.626488 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 222/450] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:16:02.265925 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-df94f5a1-2ee6-40f1-99a7-479cd4166bd1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:02.266545 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-df94f5a1-2ee6-40f1-99a7-479cd4166bd1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:02.272858 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-df94f5a1-2ee6-40f1-99a7-479cd4166bd1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:02.273380 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-df94f5a1-2ee6-40f1-99a7-479cd4166bd1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:02.273821 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-df94f5a1-2ee6-40f1-99a7-479cd4166bd1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:02.274503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-df94f5a1-2ee6-40f1-99a7-479cd4166bd1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:02.275503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-df94f5a1-2ee6-40f1-99a7-479cd4166bd1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:02.275932 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-df94f5a1-2ee6-40f1-99a7-479cd4166bd1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:02.405302 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-df94f5a1-2ee6-40f1-99a7-479cd4166bd1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:02.413481 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-df94f5a1-2ee6-40f1-99a7-479cd4166bd1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1513 microversion: 2.1 time: 0.151399 Oct 24 13:16:02.414066 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 229/451] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:02 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:02.458506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-6bb6f2df-c863-45bf-9fbe-0f3b3673e9c0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96a50e5f-05ec-43df-b264-7e33f54801bc"}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:02.460949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-6bb6f2df-c863-45bf-9fbe-0f3b3673e9c0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:02.467697 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6bb6f2df-c863-45bf-9fbe-0f3b3673e9c0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:02.468177 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6bb6f2df-c863-45bf-9fbe-0f3b3673e9c0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:02.468612 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6bb6f2df-c863-45bf-9fbe-0f3b3673e9c0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:02.469296 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6bb6f2df-c863-45bf-9fbe-0f3b3673e9c0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:02.469748 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6bb6f2df-c863-45bf-9fbe-0f3b3673e9c0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:02.470172 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6bb6f2df-c863-45bf-9fbe-0f3b3673e9c0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:02.576337 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-389f010d-209a-4cf9-a424-69fca39422ae tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:02.577086 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-389f010d-209a-4cf9-a424-69fca39422ae tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:02.585662 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-389f010d-209a-4cf9-a424-69fca39422ae tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:02.586146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-389f010d-209a-4cf9-a424-69fca39422ae tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:02.586578 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-389f010d-209a-4cf9-a424-69fca39422ae tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:02.587460 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-389f010d-209a-4cf9-a424-69fca39422ae tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:02.587756 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-389f010d-209a-4cf9-a424-69fca39422ae tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:02.588314 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-389f010d-209a-4cf9-a424-69fca39422ae tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:02.741359 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-389f010d-209a-4cf9-a424-69fca39422ae tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:02.755100 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-389f010d-209a-4cf9-a424-69fca39422ae tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1357 microversion: 2.1 time: 0.183138 Oct 24 13:16:02.755755 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 230/452] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:02 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:02.772192 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-6bb6f2df-c863-45bf-9fbe-0f3b3673e9c0 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "POST /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318227 Oct 24 13:16:02.772725 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 223/453] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 24 13:16:02 2022] POST /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:16:03.438209 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-2755a42e-64ec-4ab5-afb5-c5ddeced86f2 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:03.438825 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-2755a42e-64ec-4ab5-afb5-c5ddeced86f2 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:03.445317 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2755a42e-64ec-4ab5-afb5-c5ddeced86f2 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:03.445799 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2755a42e-64ec-4ab5-afb5-c5ddeced86f2 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:03.446231 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2755a42e-64ec-4ab5-afb5-c5ddeced86f2 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:03.446951 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2755a42e-64ec-4ab5-afb5-c5ddeced86f2 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:03.447754 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2755a42e-64ec-4ab5-afb5-c5ddeced86f2 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:03.448178 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2755a42e-64ec-4ab5-afb5-c5ddeced86f2 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:03.586577 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-2755a42e-64ec-4ab5-afb5-c5ddeced86f2 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:03.594789 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-2755a42e-64ec-4ab5-afb5-c5ddeced86f2 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1513 microversion: 2.1 time: 0.160381 Oct 24 13:16:03.595400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 231/454] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:03 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:03.780087 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-b1b99e59-6d7d-48fc-9702-955e85724d15 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:03.780832 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-b1b99e59-6d7d-48fc-9702-955e85724d15 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:03.788579 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b1b99e59-6d7d-48fc-9702-955e85724d15 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:03.789067 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b1b99e59-6d7d-48fc-9702-955e85724d15 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:03.789505 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b1b99e59-6d7d-48fc-9702-955e85724d15 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:03.790294 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b1b99e59-6d7d-48fc-9702-955e85724d15 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:03.791004 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b1b99e59-6d7d-48fc-9702-955e85724d15 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:03.791969 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b1b99e59-6d7d-48fc-9702-955e85724d15 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:03.893212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-34775aa4-8a3f-452f-959c-a8f0d334c50f tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:03.893997 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-34775aa4-8a3f-452f-959c-a8f0d334c50f tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:03.914824 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-34775aa4-8a3f-452f-959c-a8f0d334c50f tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:03.915943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-34775aa4-8a3f-452f-959c-a8f0d334c50f tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:03.916634 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-34775aa4-8a3f-452f-959c-a8f0d334c50f tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:03.917356 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-34775aa4-8a3f-452f-959c-a8f0d334c50f tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:03.917820 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-34775aa4-8a3f-452f-959c-a8f0d334c50f tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:03.918303 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-34775aa4-8a3f-452f-959c-a8f0d334c50f tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:03.945995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-34775aa4-8a3f-452f-959c-a8f0d334c50f tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd/ips" status: 200 len: 148 microversion: 2.1 time: 0.056647 Oct 24 13:16:03.952642 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 232/455] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Oct 24 13:16:03 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd/ips => generated 148 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:16:03.958700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a050e273-7334-4cc1-ba81-58bf32042925 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99be6ba9-f51a-40ba-8065-d711f27d5f99"}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:03.961254 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a050e273-7334-4cc1-ba81-58bf32042925 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:03.967807 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a050e273-7334-4cc1-ba81-58bf32042925 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:03.968296 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a050e273-7334-4cc1-ba81-58bf32042925 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:03.968727 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a050e273-7334-4cc1-ba81-58bf32042925 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:03.969414 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a050e273-7334-4cc1-ba81-58bf32042925 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:03.969866 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a050e273-7334-4cc1-ba81-58bf32042925 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:03.970360 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a050e273-7334-4cc1-ba81-58bf32042925 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:04.072763 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-a050e273-7334-4cc1-ba81-58bf32042925 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] HTTP exception thrown: Invalid volume: volume 99be6ba9-f51a-40ba-8065-d711f27d5f99 is already attached to instances: b0d11b9d-5ddc-4747-9632-d652e6c93b7b Oct 24 13:16:04.075156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a050e273-7334-4cc1-ba81-58bf32042925 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Request method failure captured: Oct 24 13:16:04.075156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: POST /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd/os-volume_attachments HTTP/1.1 Oct 24 13:16:04.075156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:16:04.075156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:16:04.075156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:16:04.075156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 74 Oct 24 13:16:04.075156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:16:04.075156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:16:04.075156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:16:04.075156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:16:04.075156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVo9AXwMG0aRbejat92eCxhMJFSv0y7_lNyhuCUN6zXnDHpFGdG48-ggi2-Do-PEfXVv_XARCMCP2kZbyq19slbwuuFeg54REDqUjfIH_fbN8NXKvJLHQXv8L_GOaWATBtTB6QuD_0kWnm_UJtW2Xnio6IxEqQIshhCCIfC1pGYUCOsE Oct 24 13:16:04.075156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:16:04.075156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:16:04.075156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:16:04.075156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:16:04.075156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:16:04.075156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:16:04.075156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:16:04.075156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:16:04.075156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:16:04.075156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:16:04.076476 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:16:04.076476 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:16:04.076476 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:16:04.076476 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:16:04.076476 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:16:04.076476 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:16:04.076476 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:16:04.076476 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: c5619c8183e04e1d9073f1b40e057967 Oct 24 13:16:04.076476 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:16:04.076476 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Oct 24 13:16:04.076476 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {"volumeAttachment": {"volumeId": "99be6ba9-f51a-40ba-8065-d711f27d5f99"}} Oct 24 13:16:04.076476 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:16:04.077334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Invalid volume: volume 99be6ba9-f51a-40ba-8065-d711f27d5f99 is already attached to instances: b0d11b9d-5ddc-4747-9632-d652e6c93b7b Oct 24 13:16:04.077334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'server_id': 'dc138711-ddfb-4b61-bf88-532641a857cd', 'body': {'volumeAttachment': {'volumeId': '99be6ba9-f51a-40ba-8065-d711f27d5f99'}}} Oct 24 13:16:04.077334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:16:04.077334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:16:04.077334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 24 13:16:04.077334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 24 13:16:04.077334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 13:16:04.077334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 13:16:04.077334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 24 13:16:04.077334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 13:16:04.077334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 24 13:16:04.077334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 24 13:16:04.077334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 24 13:16:04.077334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 24 13:16:04.077334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 99be6ba9-f51a-40ba-8065-d711f27d5f99 is already attached to instances: b0d11b9d-5ddc-4747-9632-d652e6c93b7b Oct 24 13:16:04.077334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:16:04.077334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:16:04.077334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:16:04.077334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:16:04.078516 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:16:04.078516 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:16:04.078516 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:16:04.078516 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:16:04.078516 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:16:04.078516 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:16:04.078516 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:16:04.078516 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:16:04.078516 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:16:04.078516 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:16:04.078516 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:16:04.078516 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:16:04.078516 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 24 13:16:04.078516 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 24 13:16:04.078516 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 99be6ba9-f51a-40ba-8065-d711f27d5f99 is already attached to instances: b0d11b9d-5ddc-4747-9632-d652e6c93b7b Oct 24 13:16:04.078516 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:16:04.078516 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:16:04.078516 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:16:04.078516 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:16:04.078516 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:16:04.079723 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:16:04.079723 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:16:04.079723 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:16:04.079723 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 99be6ba9-f51a-40ba-8065-d711f27d5f99 is already attached to instances: b0d11b9d-5ddc-4747-9632-d652e6c93b7b Oct 24 13:16:04.079723 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:16:04.080559 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-b1b99e59-6d7d-48fc-9702-955e85724d15 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:04.082638 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a050e273-7334-4cc1-ba81-58bf32042925 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Returning 400 to user: Invalid volume: volume 99be6ba9-f51a-40ba-8065-d711f27d5f99 is already attached to instances: b0d11b9d-5ddc-4747-9632-d652e6c93b7b {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:16:04.084382 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a050e273-7334-4cc1-ba81-58bf32042925 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "POST /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.129871 Oct 24 13:16:04.089872 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 233/456] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 24 13:16:03 2022] POST /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd/os-volume_attachments => generated 174 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 24 13:16:04.092242 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-b1b99e59-6d7d-48fc-9702-955e85724d15 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1357 microversion: 2.1 time: 0.316351 Oct 24 13:16:04.092816 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 224/457] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:03 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1357 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:04.098100 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-961417cf-fe63-4fca-9563-3d57cd5acabe tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:04.098610 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-961417cf-fe63-4fca-9563-3d57cd5acabe tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:04.104521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-961417cf-fe63-4fca-9563-3d57cd5acabe tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:04.105004 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-961417cf-fe63-4fca-9563-3d57cd5acabe tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:04.105439 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-961417cf-fe63-4fca-9563-3d57cd5acabe tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:04.106233 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-961417cf-fe63-4fca-9563-3d57cd5acabe tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:04.106693 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-961417cf-fe63-4fca-9563-3d57cd5acabe tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:04.107148 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-961417cf-fe63-4fca-9563-3d57cd5acabe tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:04.110307 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-c76bd4df-1db6-422e-b8cf-0555aca580c8 req-4192d642-14e5-493c-ae43-7d530958ffc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24354cc9-2856-455f-b89e-cd913ef97dde", "name": "network-vif-deleted", "tag": "e9210097-debc-417e-a4c0-33a08dd9bfd8"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:04.121937 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-c76bd4df-1db6-422e-b8cf-0555aca580c8 req-4192d642-14e5-493c-ae43-7d530958ffc2 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:04.122425 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-c76bd4df-1db6-422e-b8cf-0555aca580c8 req-4192d642-14e5-493c-ae43-7d530958ffc2 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:04.122859 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-c76bd4df-1db6-422e-b8cf-0555aca580c8 req-4192d642-14e5-493c-ae43-7d530958ffc2 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:04.133737 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-961417cf-fe63-4fca-9563-3d57cd5acabe tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Going to try to terminate instance {{(pid=118915) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:16:04.138370 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-c76bd4df-1db6-422e-b8cf-0555aca580c8 req-4192d642-14e5-493c-ae43-7d530958ffc2 service nova] Creating event network-vif-deleted:e9210097-debc-417e-a4c0-33a08dd9bfd8 for instance 24354cc9-2856-455f-b89e-cd913ef97dde on hv-cinder-86248 Oct 24 13:16:04.143710 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-c76bd4df-1db6-422e-b8cf-0555aca580c8 req-4192d642-14e5-493c-ae43-7d530958ffc2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052361 Oct 24 13:16:04.144861 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 234/458] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:16:04.229807 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-961417cf-fe63-4fca-9563-3d57cd5acabe tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 204 len: 0 microversion: 2.1 time: 0.135630 Oct 24 13:16:04.230385 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 225/459] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:16:04 2022] DELETE /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:16:04.239142 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-7bf1bb28-4b04-4e83-96b3-2d896f0b8090 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:04.239867 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-7bf1bb28-4b04-4e83-96b3-2d896f0b8090 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:04.247193 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7bf1bb28-4b04-4e83-96b3-2d896f0b8090 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:04.247673 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7bf1bb28-4b04-4e83-96b3-2d896f0b8090 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:04.248103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7bf1bb28-4b04-4e83-96b3-2d896f0b8090 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:04.248778 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7bf1bb28-4b04-4e83-96b3-2d896f0b8090 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:04.249225 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7bf1bb28-4b04-4e83-96b3-2d896f0b8090 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:04.249640 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7bf1bb28-4b04-4e83-96b3-2d896f0b8090 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:04.379598 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-7bf1bb28-4b04-4e83-96b3-2d896f0b8090 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:04.387537 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-7bf1bb28-4b04-4e83-96b3-2d896f0b8090 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1681 microversion: 2.1 time: 0.152547 Oct 24 13:16:04.388103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 235/460] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:04 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:04.619399 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-784e3258-0bf4-4b3f-9a75-c8562273d0a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:04.620098 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-784e3258-0bf4-4b3f-9a75-c8562273d0a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:04.625988 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-784e3258-0bf4-4b3f-9a75-c8562273d0a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:04.626470 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-784e3258-0bf4-4b3f-9a75-c8562273d0a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:04.626901 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-784e3258-0bf4-4b3f-9a75-c8562273d0a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:04.627672 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-784e3258-0bf4-4b3f-9a75-c8562273d0a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:04.628078 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-784e3258-0bf4-4b3f-9a75-c8562273d0a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:04.628496 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-784e3258-0bf4-4b3f-9a75-c8562273d0a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:04.659221 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-784e3258-0bf4-4b3f-9a75-c8562273d0a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:04.659689 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-784e3258-0bf4-4b3f-9a75-c8562273d0a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:04.660114 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-784e3258-0bf4-4b3f-9a75-c8562273d0a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:04.660548 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.objects.instance [None req-784e3258-0bf4-4b3f-9a75-c8562273d0a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lazy-loading 'fault' on Instance uuid 24354cc9-2856-455f-b89e-cd913ef97dde {{(pid=118915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:16:04.703682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-784e3258-0bf4-4b3f-9a75-c8562273d0a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:04.711282 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-784e3258-0bf4-4b3f-9a75-c8562273d0a6 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1308 microversion: 2.1 time: 0.096648 Oct 24 13:16:04.711844 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 226/461] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:04 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:05.115549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-ac3187e7-40e9-4d96-8f5c-2e2d8bff1f10 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:05.117203 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-ac3187e7-40e9-4d96-8f5c-2e2d8bff1f10 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:05.124563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ac3187e7-40e9-4d96-8f5c-2e2d8bff1f10 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:05.125048 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ac3187e7-40e9-4d96-8f5c-2e2d8bff1f10 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:05.127299 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ac3187e7-40e9-4d96-8f5c-2e2d8bff1f10 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:05.127299 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ac3187e7-40e9-4d96-8f5c-2e2d8bff1f10 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:05.127299 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ac3187e7-40e9-4d96-8f5c-2e2d8bff1f10 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:05.127299 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ac3187e7-40e9-4d96-8f5c-2e2d8bff1f10 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:05.269297 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-ac3187e7-40e9-4d96-8f5c-2e2d8bff1f10 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:05.272896 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=100 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:05.278153 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-ac3187e7-40e9-4d96-8f5c-2e2d8bff1f10 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1357 microversion: 2.1 time: 0.166665 Oct 24 13:16:05.278732 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 236/462] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:05 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:05.409733 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-20fce027-8125-4f30-bffe-672ab7352277 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:05.410346 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-20fce027-8125-4f30-bffe-672ab7352277 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:05.416895 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-20fce027-8125-4f30-bffe-672ab7352277 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:05.417375 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-20fce027-8125-4f30-bffe-672ab7352277 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:05.417808 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-20fce027-8125-4f30-bffe-672ab7352277 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:05.418492 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-20fce027-8125-4f30-bffe-672ab7352277 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:05.418938 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-20fce027-8125-4f30-bffe-672ab7352277 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:05.419386 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-20fce027-8125-4f30-bffe-672ab7352277 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:05.545881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-20fce027-8125-4f30-bffe-672ab7352277 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:05.553517 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-20fce027-8125-4f30-bffe-672ab7352277 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1681 microversion: 2.1 time: 0.147705 Oct 24 13:16:05.554069 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 227/463] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:05 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:05.734642 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d89e7616-82b7-4627-99f6-23581b67b223 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:05.735319 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-d89e7616-82b7-4627-99f6-23581b67b223 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:05.741366 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d89e7616-82b7-4627-99f6-23581b67b223 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:05.741840 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d89e7616-82b7-4627-99f6-23581b67b223 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:05.742264 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d89e7616-82b7-4627-99f6-23581b67b223 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:05.742939 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d89e7616-82b7-4627-99f6-23581b67b223 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:05.744079 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d89e7616-82b7-4627-99f6-23581b67b223 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:05.744442 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d89e7616-82b7-4627-99f6-23581b67b223 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:05.774636 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d89e7616-82b7-4627-99f6-23581b67b223 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:05.775287 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d89e7616-82b7-4627-99f6-23581b67b223 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:05.775725 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d89e7616-82b7-4627-99f6-23581b67b223 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:05.776175 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.objects.instance [None req-d89e7616-82b7-4627-99f6-23581b67b223 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lazy-loading 'fault' on Instance uuid 24354cc9-2856-455f-b89e-cd913ef97dde {{(pid=118914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:16:05.817719 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-d89e7616-82b7-4627-99f6-23581b67b223 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:05.825442 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-d89e7616-82b7-4627-99f6-23581b67b223 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1308 microversion: 2.1 time: 0.095003 Oct 24 13:16:05.826002 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 237/464] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:05 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:06.301848 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-1d76c504-6b0d-4137-a22c-5515ef52d21c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:06.302409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-1d76c504-6b0d-4137-a22c-5515ef52d21c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:06.309219 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d76c504-6b0d-4137-a22c-5515ef52d21c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:06.309702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d76c504-6b0d-4137-a22c-5515ef52d21c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:06.310135 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d76c504-6b0d-4137-a22c-5515ef52d21c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:06.310822 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d76c504-6b0d-4137-a22c-5515ef52d21c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:06.311354 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d76c504-6b0d-4137-a22c-5515ef52d21c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:06.311755 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d76c504-6b0d-4137-a22c-5515ef52d21c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:06.444194 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-1d76c504-6b0d-4137-a22c-5515ef52d21c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:06.452834 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-1d76c504-6b0d-4137-a22c-5515ef52d21c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1357 microversion: 2.1 time: 0.154890 Oct 24 13:16:06.453405 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 228/465] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:06 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:06.577403 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-b32fddb1-e27f-45c4-84b7-4742ac829ffd tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:06.578015 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-b32fddb1-e27f-45c4-84b7-4742ac829ffd tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:06.584382 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b32fddb1-e27f-45c4-84b7-4742ac829ffd tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:06.584858 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b32fddb1-e27f-45c4-84b7-4742ac829ffd tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:06.585317 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b32fddb1-e27f-45c4-84b7-4742ac829ffd tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:06.585972 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b32fddb1-e27f-45c4-84b7-4742ac829ffd tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:06.586421 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b32fddb1-e27f-45c4-84b7-4742ac829ffd tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:06.586837 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b32fddb1-e27f-45c4-84b7-4742ac829ffd tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:06.721055 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-b32fddb1-e27f-45c4-84b7-4742ac829ffd tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:06.729532 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-b32fddb1-e27f-45c4-84b7-4742ac829ffd tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1681 microversion: 2.1 time: 0.155821 Oct 24 13:16:06.730086 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 238/466] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:06 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:06.848491 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-23d3407f-680b-4ac3-811e-e5774fabc1fd tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:06.849027 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-23d3407f-680b-4ac3-811e-e5774fabc1fd tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:06.854910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-23d3407f-680b-4ac3-811e-e5774fabc1fd tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:06.855418 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-23d3407f-680b-4ac3-811e-e5774fabc1fd tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:06.855852 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-23d3407f-680b-4ac3-811e-e5774fabc1fd tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:06.856533 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-23d3407f-680b-4ac3-811e-e5774fabc1fd tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:06.856984 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-23d3407f-680b-4ac3-811e-e5774fabc1fd tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:06.857404 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-23d3407f-680b-4ac3-811e-e5774fabc1fd tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:06.887860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-23d3407f-680b-4ac3-811e-e5774fabc1fd tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:06.888332 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-23d3407f-680b-4ac3-811e-e5774fabc1fd tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:06.888760 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-23d3407f-680b-4ac3-811e-e5774fabc1fd tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:06.889199 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.objects.instance [None req-23d3407f-680b-4ac3-811e-e5774fabc1fd tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lazy-loading 'fault' on Instance uuid 24354cc9-2856-455f-b89e-cd913ef97dde {{(pid=118915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:16:06.927577 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-23d3407f-680b-4ac3-811e-e5774fabc1fd tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:06.935626 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-23d3407f-680b-4ac3-811e-e5774fabc1fd tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 200 len: 1308 microversion: 2.1 time: 0.091125 Oct 24 13:16:06.936189 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 229/467] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:06 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:07.476544 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-b6767d5c-036e-416b-a676-b2cf5626d944 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:07.477386 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-b6767d5c-036e-416b-a676-b2cf5626d944 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:07.483935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b6767d5c-036e-416b-a676-b2cf5626d944 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:07.484477 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b6767d5c-036e-416b-a676-b2cf5626d944 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:07.484975 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b6767d5c-036e-416b-a676-b2cf5626d944 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:07.485725 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b6767d5c-036e-416b-a676-b2cf5626d944 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:07.486241 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b6767d5c-036e-416b-a676-b2cf5626d944 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:07.486726 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b6767d5c-036e-416b-a676-b2cf5626d944 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:07.622174 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-b6767d5c-036e-416b-a676-b2cf5626d944 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:07.629945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-b6767d5c-036e-416b-a676-b2cf5626d944 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1357 microversion: 2.1 time: 0.157339 Oct 24 13:16:07.630500 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 239/468] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:07 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:07.754268 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8251537d-427f-4255-b64c-78c719fb6cee tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:07.754883 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-8251537d-427f-4255-b64c-78c719fb6cee tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:07.762341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8251537d-427f-4255-b64c-78c719fb6cee tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:07.762819 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8251537d-427f-4255-b64c-78c719fb6cee tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:07.763290 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8251537d-427f-4255-b64c-78c719fb6cee tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:07.764172 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8251537d-427f-4255-b64c-78c719fb6cee tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:07.764629 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8251537d-427f-4255-b64c-78c719fb6cee tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:07.765040 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8251537d-427f-4255-b64c-78c719fb6cee tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:07.850602 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-3a25c44d-1a61-457e-aa6e-34fdd9a99d51 req-17f6de51-e72b-414d-9773-95c4c644546f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc138711-ddfb-4b61-bf88-532641a857cd", "name": "network-vif-deleted", "tag": "37f90190-526c-4317-90a1-c6197bdf36c1"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:07.862439 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-8251537d-427f-4255-b64c-78c719fb6cee tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:07.866467 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-3a25c44d-1a61-457e-aa6e-34fdd9a99d51 req-17f6de51-e72b-414d-9773-95c4c644546f service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:07.867542 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-3a25c44d-1a61-457e-aa6e-34fdd9a99d51 req-17f6de51-e72b-414d-9773-95c4c644546f service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:07.869559 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-3a25c44d-1a61-457e-aa6e-34fdd9a99d51 req-17f6de51-e72b-414d-9773-95c4c644546f service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:07.872516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-8251537d-427f-4255-b64c-78c719fb6cee tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1613 microversion: 2.1 time: 0.122133 Oct 24 13:16:07.883482 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 230/469] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:07 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1613 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:07.896127 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-3a25c44d-1a61-457e-aa6e-34fdd9a99d51 req-17f6de51-e72b-414d-9773-95c4c644546f service nova] Creating event network-vif-deleted:37f90190-526c-4317-90a1-c6197bdf36c1 for instance dc138711-ddfb-4b61-bf88-532641a857cd on hv-cinder-86248 Oct 24 13:16:07.902251 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-3a25c44d-1a61-457e-aa6e-34fdd9a99d51 req-17f6de51-e72b-414d-9773-95c4c644546f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059008 Oct 24 13:16:07.902864 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 240/470] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:16:07.958960 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-6661721a-8c46-425b-88e5-fa39ef9dfd7f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:07.959623 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-6661721a-8c46-425b-88e5-fa39ef9dfd7f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 24354cc9-2856-455f-b89e-cd913ef97dde] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:07.966585 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6661721a-8c46-425b-88e5-fa39ef9dfd7f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:07.967455 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6661721a-8c46-425b-88e5-fa39ef9dfd7f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:07.968104 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6661721a-8c46-425b-88e5-fa39ef9dfd7f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:07.969038 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6661721a-8c46-425b-88e5-fa39ef9dfd7f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:07.969698 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6661721a-8c46-425b-88e5-fa39ef9dfd7f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:07.970395 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6661721a-8c46-425b-88e5-fa39ef9dfd7f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:07.984696 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-6661721a-8c46-425b-88e5-fa39ef9dfd7f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] HTTP exception thrown: Instance 24354cc9-2856-455f-b89e-cd913ef97dde could not be found. Oct 24 13:16:07.986521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-6661721a-8c46-425b-88e5-fa39ef9dfd7f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Request method failure captured: Oct 24 13:16:07.986521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde HTTP/1.1 Oct 24 13:16:07.986521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:16:07.986521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:16:07.986521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:16:07.986521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:16:07.986521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:16:07.986521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:16:07.986521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:16:07.986521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:16:07.986521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo-ytXsiU5jwHHSxQ-38u7BeXV-E4Ea-rbYzHBeFO5VD4oPVNkG2N-o7Z5QCkfFsOaVBMQrlFMchgdgrh_TuCZVIMXNdn1tSyB7hCI5horlIQG6SIsvwnmHQC-p0TH7alpf2BpG1k6zdTxXRsd-T5weTZ09dsqFAuADqgUB9b5A_fiw Oct 24 13:16:07.986521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:16:07.986521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:16:07.986521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:16:07.986521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:16:07.986521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:16:07.986521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:16:07.986521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: f027aba5a38b422fbc30d64b9ee2ef79 Oct 24 13:16:07.986521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1800166311 Oct 24 13:16:07.986521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:16:07.986521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:16:07.988061 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f027aba5a38b422fbc30d64b9ee2ef79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f027aba5a38b422fbc30d64b9ee2ef79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f027aba5a38b422fbc30d64b9ee2ef79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f027aba5a38b422fbc30d64b9ee2ef79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:16:07.988061 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-VolumesSnapshotTestJSON-1800166311 Oct 24 13:16:07.988061 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: f027aba5a38b422fbc30d64b9ee2ef79 Oct 24 13:16:07.988061 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1800166311 Oct 24 13:16:07.988061 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-VolumesSnapshotTestJSON-1800166311-project Oct 24 13:16:07.988061 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:16:07.988061 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:16:07.988061 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: abd7bde497c14d25a06c276609aa143f Oct 24 13:16:07.988061 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-VolumesSnapshotTestJSON-1800166311-project Oct 24 13:16:07.988061 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:16:07.988061 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Instance 24354cc9-2856-455f-b89e-cd913ef97dde could not be found. Oct 24 13:16:07.988061 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': '24354cc9-2856-455f-b89e-cd913ef97dde'} Oct 24 13:16:07.988916 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:16:07.988916 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:16:07.988916 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:16:07.988916 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:16:07.988916 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:16:07.988916 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:16:07.988916 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:16:07.988916 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:16:07.988916 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:16:07.988916 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:16:07.988916 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24354cc9-2856-455f-b89e-cd913ef97dde could not be found. Oct 24 13:16:07.988916 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:16:07.988916 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:16:07.988916 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:16:07.988916 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:16:07.988916 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:16:07.988916 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:16:07.988916 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:16:07.988916 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:16:07.988916 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:16:07.990263 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:16:07.990263 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:16:07.990263 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:16:07.990263 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:16:07.990263 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:16:07.990263 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:16:07.990263 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:16:07.990263 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24354cc9-2856-455f-b89e-cd913ef97dde could not be found. Oct 24 13:16:07.990263 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:16:07.990263 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:16:07.990263 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:16:07.990263 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:16:07.990263 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:16:07.990263 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:16:07.990263 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:16:07.990263 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:16:07.990263 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24354cc9-2856-455f-b89e-cd913ef97dde could not be found. Oct 24 13:16:07.990263 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:16:07.993011 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-6661721a-8c46-425b-88e5-fa39ef9dfd7f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Returning 404 to user: Instance 24354cc9-2856-455f-b89e-cd913ef97dde could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:16:07.994428 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-6661721a-8c46-425b-88e5-fa39ef9dfd7f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde" status: 404 len: 111 microversion: 2.1 time: 0.039279 Oct 24 13:16:07.995236 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 231/471] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:07 2022] GET /compute/v2.1/servers/24354cc9-2856-455f-b89e-cd913ef97dde => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:16:08.654042 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-fa2c020f-a5ca-4a37-b31b-0fd9d78f132b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:08.654773 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-fa2c020f-a5ca-4a37-b31b-0fd9d78f132b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:08.661672 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa2c020f-a5ca-4a37-b31b-0fd9d78f132b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:08.662165 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa2c020f-a5ca-4a37-b31b-0fd9d78f132b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:08.662659 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa2c020f-a5ca-4a37-b31b-0fd9d78f132b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:08.663408 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa2c020f-a5ca-4a37-b31b-0fd9d78f132b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:08.663890 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa2c020f-a5ca-4a37-b31b-0fd9d78f132b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:08.664318 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa2c020f-a5ca-4a37-b31b-0fd9d78f132b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:08.803504 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-fa2c020f-a5ca-4a37-b31b-0fd9d78f132b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:08.813498 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-fa2c020f-a5ca-4a37-b31b-0fd9d78f132b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1357 microversion: 2.1 time: 0.163560 Oct 24 13:16:08.814409 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 241/472] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:08 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:08.897956 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-f3dde932-13b6-4fda-b409-56c4fea7cc3d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:08.898590 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-f3dde932-13b6-4fda-b409-56c4fea7cc3d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:08.905073 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f3dde932-13b6-4fda-b409-56c4fea7cc3d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:08.905555 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f3dde932-13b6-4fda-b409-56c4fea7cc3d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:08.905995 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f3dde932-13b6-4fda-b409-56c4fea7cc3d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:08.906956 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f3dde932-13b6-4fda-b409-56c4fea7cc3d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:08.907834 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f3dde932-13b6-4fda-b409-56c4fea7cc3d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:08.908120 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f3dde932-13b6-4fda-b409-56c4fea7cc3d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:08.913231 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:08.942444 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f3dde932-13b6-4fda-b409-56c4fea7cc3d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:08.942926 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f3dde932-13b6-4fda-b409-56c4fea7cc3d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:08.943382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f3dde932-13b6-4fda-b409-56c4fea7cc3d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:08.943831 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.objects.instance [None req-f3dde932-13b6-4fda-b409-56c4fea7cc3d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lazy-loading 'fault' on Instance uuid dc138711-ddfb-4b61-bf88-532641a857cd {{(pid=118915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:16:08.992655 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-f3dde932-13b6-4fda-b409-56c4fea7cc3d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:09.001390 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-f3dde932-13b6-4fda-b409-56c4fea7cc3d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1332 microversion: 2.1 time: 0.107050 Oct 24 13:16:09.006479 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 232/473] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:08 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:09.839903 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-0634fb97-7fe1-4e0f-bc32-d767d1c5e9c5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:09.840513 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-0634fb97-7fe1-4e0f-bc32-d767d1c5e9c5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:09.847626 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0634fb97-7fe1-4e0f-bc32-d767d1c5e9c5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:09.848128 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0634fb97-7fe1-4e0f-bc32-d767d1c5e9c5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:09.848574 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0634fb97-7fe1-4e0f-bc32-d767d1c5e9c5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:09.849327 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0634fb97-7fe1-4e0f-bc32-d767d1c5e9c5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:09.849790 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0634fb97-7fe1-4e0f-bc32-d767d1c5e9c5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:09.850220 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0634fb97-7fe1-4e0f-bc32-d767d1c5e9c5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:09.986675 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-0634fb97-7fe1-4e0f-bc32-d767d1c5e9c5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:09.994921 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-0634fb97-7fe1-4e0f-bc32-d767d1c5e9c5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1357 microversion: 2.1 time: 0.159294 Oct 24 13:16:09.995481 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 242/474] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:09 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:10.025351 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-bfd4951f-b7c4-472e-906d-66bb93575ed4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:10.025971 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-bfd4951f-b7c4-472e-906d-66bb93575ed4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:10.032556 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bfd4951f-b7c4-472e-906d-66bb93575ed4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:10.033042 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bfd4951f-b7c4-472e-906d-66bb93575ed4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:10.033481 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bfd4951f-b7c4-472e-906d-66bb93575ed4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:10.034172 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bfd4951f-b7c4-472e-906d-66bb93575ed4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:10.034628 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bfd4951f-b7c4-472e-906d-66bb93575ed4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:10.035076 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bfd4951f-b7c4-472e-906d-66bb93575ed4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:10.066532 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bfd4951f-b7c4-472e-906d-66bb93575ed4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:10.067015 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bfd4951f-b7c4-472e-906d-66bb93575ed4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:10.067483 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bfd4951f-b7c4-472e-906d-66bb93575ed4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:10.067932 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.objects.instance [None req-bfd4951f-b7c4-472e-906d-66bb93575ed4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lazy-loading 'fault' on Instance uuid dc138711-ddfb-4b61-bf88-532641a857cd {{(pid=118915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:16:10.119180 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-bfd4951f-b7c4-472e-906d-66bb93575ed4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:10.126709 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-bfd4951f-b7c4-472e-906d-66bb93575ed4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1332 microversion: 2.1 time: 0.105326 Oct 24 13:16:10.127295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 233/475] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:10 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:11.018847 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-cb5caaef-cdf6-4d22-997d-da6f7771d8a6 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:11.019515 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-cb5caaef-cdf6-4d22-997d-da6f7771d8a6 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:11.025982 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cb5caaef-cdf6-4d22-997d-da6f7771d8a6 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:11.026469 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cb5caaef-cdf6-4d22-997d-da6f7771d8a6 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:11.026908 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cb5caaef-cdf6-4d22-997d-da6f7771d8a6 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:11.027629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cb5caaef-cdf6-4d22-997d-da6f7771d8a6 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:11.028087 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cb5caaef-cdf6-4d22-997d-da6f7771d8a6 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:11.028514 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cb5caaef-cdf6-4d22-997d-da6f7771d8a6 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:11.149976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-1aa4b793-2b3d-4ac1-9c8a-e9fe9b914a1c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:11.150697 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-1aa4b793-2b3d-4ac1-9c8a-e9fe9b914a1c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:11.158942 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1aa4b793-2b3d-4ac1-9c8a-e9fe9b914a1c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:11.160158 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1aa4b793-2b3d-4ac1-9c8a-e9fe9b914a1c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:11.161089 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1aa4b793-2b3d-4ac1-9c8a-e9fe9b914a1c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:11.162229 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1aa4b793-2b3d-4ac1-9c8a-e9fe9b914a1c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:11.162891 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1aa4b793-2b3d-4ac1-9c8a-e9fe9b914a1c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:11.163360 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1aa4b793-2b3d-4ac1-9c8a-e9fe9b914a1c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:11.182647 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-cb5caaef-cdf6-4d22-997d-da6f7771d8a6 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:11.191724 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-cb5caaef-cdf6-4d22-997d-da6f7771d8a6 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1357 microversion: 2.1 time: 0.176640 Oct 24 13:16:11.192308 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 243/476] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:11 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:11.204369 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1aa4b793-2b3d-4ac1-9c8a-e9fe9b914a1c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:11.204849 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1aa4b793-2b3d-4ac1-9c8a-e9fe9b914a1c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:11.205274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1aa4b793-2b3d-4ac1-9c8a-e9fe9b914a1c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:11.205939 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.objects.instance [None req-1aa4b793-2b3d-4ac1-9c8a-e9fe9b914a1c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lazy-loading 'fault' on Instance uuid dc138711-ddfb-4b61-bf88-532641a857cd {{(pid=118915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:16:11.251326 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-1aa4b793-2b3d-4ac1-9c8a-e9fe9b914a1c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:11.258877 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-1aa4b793-2b3d-4ac1-9c8a-e9fe9b914a1c tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 200 len: 1332 microversion: 2.1 time: 0.113603 Oct 24 13:16:11.261344 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 234/477] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:11 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 1332 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:11.332137 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-360466cd-d2b5-4490-a5e3-ebeb1dfccebf req-a92f31be-d910-47ab-bebb-139f7513b569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5633650-dcf9-49be-b565-3e8fb5a765f4", "name": "network-vif-plugged", "status": "completed", "tag": "018f2d3e-909b-488a-af88-b11609f2409d"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:11.344100 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-360466cd-d2b5-4490-a5e3-ebeb1dfccebf req-a92f31be-d910-47ab-bebb-139f7513b569 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:11.344915 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-360466cd-d2b5-4490-a5e3-ebeb1dfccebf req-a92f31be-d910-47ab-bebb-139f7513b569 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:11.345563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-360466cd-d2b5-4490-a5e3-ebeb1dfccebf req-a92f31be-d910-47ab-bebb-139f7513b569 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:11.360258 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-360466cd-d2b5-4490-a5e3-ebeb1dfccebf req-a92f31be-d910-47ab-bebb-139f7513b569 service nova] Creating event network-vif-plugged:018f2d3e-909b-488a-af88-b11609f2409d for instance e5633650-dcf9-49be-b565-3e8fb5a765f4 on hv-cinder-86248 Oct 24 13:16:11.365511 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-360466cd-d2b5-4490-a5e3-ebeb1dfccebf req-a92f31be-d910-47ab-bebb-139f7513b569 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040712 Oct 24 13:16:11.366499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 244/478] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:16:12.215311 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-c2469e87-d0bc-4ee7-a8ed-70c35a43bd4c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:12.215847 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-c2469e87-d0bc-4ee7-a8ed-70c35a43bd4c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:12.222188 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c2469e87-d0bc-4ee7-a8ed-70c35a43bd4c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:12.222667 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c2469e87-d0bc-4ee7-a8ed-70c35a43bd4c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:12.223124 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c2469e87-d0bc-4ee7-a8ed-70c35a43bd4c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:12.223813 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c2469e87-d0bc-4ee7-a8ed-70c35a43bd4c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:12.224262 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c2469e87-d0bc-4ee7-a8ed-70c35a43bd4c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:12.224677 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c2469e87-d0bc-4ee7-a8ed-70c35a43bd4c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:12.284737 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-5eef5413-f929-442b-9298-23d275a7a678 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:12.286078 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-5eef5413-f929-442b-9298-23d275a7a678 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:12.292883 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5eef5413-f929-442b-9298-23d275a7a678 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:12.293494 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5eef5413-f929-442b-9298-23d275a7a678 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:12.294035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5eef5413-f929-442b-9298-23d275a7a678 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:12.294869 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5eef5413-f929-442b-9298-23d275a7a678 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:12.295348 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5eef5413-f929-442b-9298-23d275a7a678 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:12.295968 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5eef5413-f929-442b-9298-23d275a7a678 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:12.310503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-5eef5413-f929-442b-9298-23d275a7a678 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] HTTP exception thrown: Instance dc138711-ddfb-4b61-bf88-532641a857cd could not be found. Oct 24 13:16:12.312171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-5eef5413-f929-442b-9298-23d275a7a678 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Request method failure captured: Oct 24 13:16:12.312171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd HTTP/1.1 Oct 24 13:16:12.312171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:16:12.312171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:16:12.312171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:16:12.312171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:16:12.312171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:16:12.312171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:16:12.312171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:16:12.312171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:16:12.312171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVo9AXwMG0aRbejat92eCxhMJFSv0y7_lNyhuCUN6zXnDHpFGdG48-ggi2-Do-PEfXVv_XARCMCP2kZbyq19slbwuuFeg54REDqUjfIH_fbN8NXKvJLHQXv8L_GOaWATBtTB6QuD_0kWnm_UJtW2Xnio6IxEqQIshhCCIfC1pGYUCOsE Oct 24 13:16:12.312171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:16:12.312171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:16:12.312171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:16:12.312171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:16:12.312171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:16:12.312171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:16:12.312171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:16:12.312171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:16:12.312171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:16:12.312171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:16:12.313685 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:16:12.313685 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:16:12.313685 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:16:12.313685 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:16:12.313685 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:16:12.313685 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:16:12.313685 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:16:12.313685 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: c5619c8183e04e1d9073f1b40e057967 Oct 24 13:16:12.313685 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:16:12.313685 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:16:12.313685 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Instance dc138711-ddfb-4b61-bf88-532641a857cd could not be found. Oct 24 13:16:12.313685 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': 'dc138711-ddfb-4b61-bf88-532641a857cd'} Oct 24 13:16:12.314523 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:16:12.314523 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:16:12.314523 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:16:12.314523 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:16:12.314523 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:16:12.314523 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:16:12.314523 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:16:12.314523 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:16:12.314523 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:16:12.314523 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:16:12.314523 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc138711-ddfb-4b61-bf88-532641a857cd could not be found. Oct 24 13:16:12.314523 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:16:12.314523 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:16:12.314523 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:16:12.314523 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:16:12.314523 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:16:12.314523 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:16:12.314523 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:16:12.314523 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:16:12.314523 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:16:12.315848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:16:12.315848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:16:12.315848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:16:12.315848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:16:12.315848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:16:12.315848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:16:12.315848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:16:12.315848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc138711-ddfb-4b61-bf88-532641a857cd could not be found. Oct 24 13:16:12.315848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:16:12.315848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:16:12.315848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:16:12.315848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:16:12.315848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:16:12.315848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:16:12.315848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:16:12.315848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:16:12.315848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc138711-ddfb-4b61-bf88-532641a857cd could not be found. Oct 24 13:16:12.315848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:16:12.317815 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-5eef5413-f929-442b-9298-23d275a7a678 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Returning 404 to user: Instance dc138711-ddfb-4b61-bf88-532641a857cd could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:16:12.318833 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-5eef5413-f929-442b-9298-23d275a7a678 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 404 len: 111 microversion: 2.1 time: 0.038881 Oct 24 13:16:12.319445 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 245/479] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:12 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:16:12.330335 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-ba450ce0-4b54-435f-b872-35b51ea74e1d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '.version_select at 0x7fad2859a670>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:12.351941 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-ba450ce0-4b54-435f-b872-35b51ea74e1d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1561423763" status: 202 len: 0 microversion: 2.1 time: 0.025882 Oct 24 13:16:12.356528 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 246/480] 10.222.0.42 () {58 vars in 1221 bytes} [Mon Oct 24 13:16:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1561423763 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 13:16:12.362973 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-c2469e87-d0bc-4ee7-a8ed-70c35a43bd4c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:12.375689 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-c2469e87-d0bc-4ee7-a8ed-70c35a43bd4c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1357 microversion: 2.1 time: 0.164296 Oct 24 13:16:12.376444 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 235/481] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:12 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:12.488481 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-7397bb17-25e3-4c06-ae91-c16abfd7d827 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:12.490697 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-7397bb17-25e3-4c06-ae91-c16abfd7d827 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:12.497484 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7397bb17-25e3-4c06-ae91-c16abfd7d827 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:12.497975 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7397bb17-25e3-4c06-ae91-c16abfd7d827 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:12.498417 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7397bb17-25e3-4c06-ae91-c16abfd7d827 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:12.499132 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7397bb17-25e3-4c06-ae91-c16abfd7d827 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:12.499596 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7397bb17-25e3-4c06-ae91-c16abfd7d827 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:12.500024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7397bb17-25e3-4c06-ae91-c16abfd7d827 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:12.531722 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.objects.instance [None req-7397bb17-25e3-4c06-ae91-c16abfd7d827 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lazy-loading 'flavor' on Instance uuid 6bd238e2-4223-465c-8028-c291fe1db874 {{(pid=118914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:16:12.676761 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-7397bb17-25e3-4c06-ae91-c16abfd7d827 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "POST /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/action" status: 200 len: 32 microversion: 2.1 time: 0.192150 Oct 24 13:16:12.677626 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 247/482] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 24 13:16:12 2022] POST /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/action => generated 32 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:16:12.687553 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-2a875f10-1804-43c7-8983-423fdf1ccdad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:12.688165 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-2a875f10-1804-43c7-8983-423fdf1ccdad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:12.694327 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2a875f10-1804-43c7-8983-423fdf1ccdad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:12.694815 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2a875f10-1804-43c7-8983-423fdf1ccdad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:12.695280 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2a875f10-1804-43c7-8983-423fdf1ccdad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:12.696278 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2a875f10-1804-43c7-8983-423fdf1ccdad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:12.696747 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2a875f10-1804-43c7-8983-423fdf1ccdad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:12.697337 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2a875f10-1804-43c7-8983-423fdf1ccdad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:12.969555 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-2a875f10-1804-43c7-8983-423fdf1ccdad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:12.978365 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-2a875f10-1804-43c7-8983-423fdf1ccdad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1736 microversion: 2.1 time: 0.294034 Oct 24 13:16:12.979147 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 236/483] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:12 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1736 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:13.265350 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-5df7ef40-34ee-450b-a160-94c4c2688309 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:13.265931 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-5df7ef40-34ee-450b-a160-94c4c2688309 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:13.272014 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5df7ef40-34ee-450b-a160-94c4c2688309 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:13.272488 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5df7ef40-34ee-450b-a160-94c4c2688309 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:13.272918 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5df7ef40-34ee-450b-a160-94c4c2688309 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:13.273595 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5df7ef40-34ee-450b-a160-94c4c2688309 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:13.274042 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5df7ef40-34ee-450b-a160-94c4c2688309 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:13.275655 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5df7ef40-34ee-450b-a160-94c4c2688309 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:13.397582 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-71683ed4-e102-4b6f-ac98-03baa18330cf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:13.398199 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-71683ed4-e102-4b6f-ac98-03baa18330cf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:13.401109 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.objects.instance [None req-5df7ef40-34ee-450b-a160-94c4c2688309 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lazy-loading 'services' on Instance uuid b0d11b9d-5ddc-4747-9632-d652e6c93b7b {{(pid=118914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:16:13.405298 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-71683ed4-e102-4b6f-ac98-03baa18330cf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:13.405777 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-71683ed4-e102-4b6f-ac98-03baa18330cf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:13.406213 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-71683ed4-e102-4b6f-ac98-03baa18330cf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:13.406898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-71683ed4-e102-4b6f-ac98-03baa18330cf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:13.407441 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-71683ed4-e102-4b6f-ac98-03baa18330cf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:13.407865 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-71683ed4-e102-4b6f-ac98-03baa18330cf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:13.530165 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-5df7ef40-34ee-450b-a160-94c4c2688309 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b/os-volume_attachments/99be6ba9-f51a-40ba-8065-d711f27d5f99" status: 202 len: 0 microversion: 2.1 time: 0.269471 Oct 24 13:16:13.530751 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 248/484] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 24 13:16:13 2022] DELETE /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b/os-volume_attachments/99be6ba9-f51a-40ba-8065-d711f27d5f99 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:16:13.539761 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-8be52f65-d691-42d5-b5a8-757611c9a4d3 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:13.542357 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-8be52f65-d691-42d5-b5a8-757611c9a4d3 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:13.549183 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8be52f65-d691-42d5-b5a8-757611c9a4d3 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:13.549676 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8be52f65-d691-42d5-b5a8-757611c9a4d3 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:13.550115 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8be52f65-d691-42d5-b5a8-757611c9a4d3 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:13.550806 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8be52f65-d691-42d5-b5a8-757611c9a4d3 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:13.550951 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-71683ed4-e102-4b6f-ac98-03baa18330cf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:13.551287 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8be52f65-d691-42d5-b5a8-757611c9a4d3 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:13.551712 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8be52f65-d691-42d5-b5a8-757611c9a4d3 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:13.559411 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-71683ed4-e102-4b6f-ac98-03baa18330cf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1357 microversion: 2.1 time: 0.165559 Oct 24 13:16:13.559980 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 237/485] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:13 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:13.582978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-8be52f65-d691-42d5-b5a8-757611c9a4d3 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047588 Oct 24 13:16:13.583559 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 249/486] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:16:13 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:16:14.003395 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-149d9b9d-fa37-4a7b-823d-45f244d9d23f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:14.004012 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-149d9b9d-fa37-4a7b-823d-45f244d9d23f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:14.010257 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-149d9b9d-fa37-4a7b-823d-45f244d9d23f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:14.011000 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-149d9b9d-fa37-4a7b-823d-45f244d9d23f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:14.011462 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-149d9b9d-fa37-4a7b-823d-45f244d9d23f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:14.012159 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-149d9b9d-fa37-4a7b-823d-45f244d9d23f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:14.012612 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-149d9b9d-fa37-4a7b-823d-45f244d9d23f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:14.013041 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-149d9b9d-fa37-4a7b-823d-45f244d9d23f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:14.155494 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-149d9b9d-fa37-4a7b-823d-45f244d9d23f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:14.163625 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-149d9b9d-fa37-4a7b-823d-45f244d9d23f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1736 microversion: 2.1 time: 0.164112 Oct 24 13:16:14.164197 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 238/487] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:13 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:14.582685 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-e06bd930-2ced-401f-901c-a0c9a1cb8601 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:14.583323 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-e06bd930-2ced-401f-901c-a0c9a1cb8601 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:14.589678 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e06bd930-2ced-401f-901c-a0c9a1cb8601 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:14.590151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e06bd930-2ced-401f-901c-a0c9a1cb8601 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:14.590871 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e06bd930-2ced-401f-901c-a0c9a1cb8601 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:14.591299 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e06bd930-2ced-401f-901c-a0c9a1cb8601 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:14.591749 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e06bd930-2ced-401f-901c-a0c9a1cb8601 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:14.592170 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e06bd930-2ced-401f-901c-a0c9a1cb8601 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:14.595913 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-201721ae-9002-4720-8976-054f9da6b1d9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:14.598158 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-201721ae-9002-4720-8976-054f9da6b1d9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:14.605094 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-201721ae-9002-4720-8976-054f9da6b1d9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:14.605577 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-201721ae-9002-4720-8976-054f9da6b1d9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:14.606010 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-201721ae-9002-4720-8976-054f9da6b1d9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:14.606698 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-201721ae-9002-4720-8976-054f9da6b1d9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:14.607190 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-201721ae-9002-4720-8976-054f9da6b1d9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:14.607615 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-201721ae-9002-4720-8976-054f9da6b1d9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:14.639445 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-201721ae-9002-4720-8976-054f9da6b1d9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047377 Oct 24 13:16:14.640028 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 239/488] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:16:14 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:16:14.725003 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-e06bd930-2ced-401f-901c-a0c9a1cb8601 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:14.733511 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-e06bd930-2ced-401f-901c-a0c9a1cb8601 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1357 microversion: 2.1 time: 0.154540 Oct 24 13:16:14.734080 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 250/489] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:14 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:15.187459 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-0a19d05e-d6e9-447a-a59d-39d07470cd98 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:15.188064 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-0a19d05e-d6e9-447a-a59d-39d07470cd98 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:15.193924 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a19d05e-d6e9-447a-a59d-39d07470cd98 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:15.194395 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a19d05e-d6e9-447a-a59d-39d07470cd98 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:15.194825 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a19d05e-d6e9-447a-a59d-39d07470cd98 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:15.195523 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a19d05e-d6e9-447a-a59d-39d07470cd98 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:15.195971 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a19d05e-d6e9-447a-a59d-39d07470cd98 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:15.196729 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0a19d05e-d6e9-447a-a59d-39d07470cd98 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:15.327106 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-0a19d05e-d6e9-447a-a59d-39d07470cd98 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:15.335276 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-0a19d05e-d6e9-447a-a59d-39d07470cd98 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1736 microversion: 2.1 time: 0.151555 Oct 24 13:16:15.335775 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 240/490] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:15 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:15.652303 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c5a99db0-0a1f-4676-ae0c-dd3e71d8e655 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:15.654544 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-c5a99db0-0a1f-4676-ae0c-dd3e71d8e655 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:15.656983 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:15.662872 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c5a99db0-0a1f-4676-ae0c-dd3e71d8e655 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:15.663380 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c5a99db0-0a1f-4676-ae0c-dd3e71d8e655 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:15.663814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c5a99db0-0a1f-4676-ae0c-dd3e71d8e655 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:15.664494 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c5a99db0-0a1f-4676-ae0c-dd3e71d8e655 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:15.665058 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c5a99db0-0a1f-4676-ae0c-dd3e71d8e655 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:15.665611 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c5a99db0-0a1f-4676-ae0c-dd3e71d8e655 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:15.697176 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-c5a99db0-0a1f-4676-ae0c-dd3e71d8e655 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048723 Oct 24 13:16:15.697716 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 251/491] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:16:15 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:16:15.756940 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-14078658-76e2-47db-979a-b201a7fbb18d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:15.757549 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-14078658-76e2-47db-979a-b201a7fbb18d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:15.764984 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-14078658-76e2-47db-979a-b201a7fbb18d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:15.765456 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-14078658-76e2-47db-979a-b201a7fbb18d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:15.765885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-14078658-76e2-47db-979a-b201a7fbb18d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:15.766560 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-14078658-76e2-47db-979a-b201a7fbb18d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:15.767021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-14078658-76e2-47db-979a-b201a7fbb18d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:15.767456 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-14078658-76e2-47db-979a-b201a7fbb18d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:15.933082 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-14078658-76e2-47db-979a-b201a7fbb18d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:15.941051 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-14078658-76e2-47db-979a-b201a7fbb18d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1357 microversion: 2.1 time: 0.187943 Oct 24 13:16:15.941616 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 241/492] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:15 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:15.953654 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-e18e3268-cb2a-436f-8618-ababb7d49ac1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-612533964", "imageRef": "4d2e5f3e-4aee-48d2-8ada-0b420d141f1b", "flavorRef": "452", "networks": [{"uuid": "016f1aff-2ba1-4abc-bd75-db4946db568d"}]}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:16.006269 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.network.neutron [None req-e18e3268-cb2a-436f-8618-ababb7d49ac1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] validate_networks() for [('016f1aff-2ba1-4abc-bd75-db4946db568d', None, None, None, None, None)] {{(pid=118914) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:16:16.353190 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-e18e3268-cb2a-436f-8618-ababb7d49ac1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Flavor limits 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:16:16.353626 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-e18e3268-cb2a-436f-8618-ababb7d49ac1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Image limits 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:16:16.354143 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-e18e3268-cb2a-436f-8618-ababb7d49ac1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Flavor pref 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:16:16.354616 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-e18e3268-cb2a-436f-8618-ababb7d49ac1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Image pref 0:0:0 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:16:16.355045 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.virt.hardware [None req-e18e3268-cb2a-436f-8618-ababb7d49ac1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118914) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:16:16.359668 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-68c1c676-cf6e-4c4b-a7ba-db412aedae01 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:16.360281 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-68c1c676-cf6e-4c4b-a7ba-db412aedae01 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:16.364321 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e18e3268-cb2a-436f-8618-ababb7d49ac1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:16.364803 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e18e3268-cb2a-436f-8618-ababb7d49ac1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:16.365242 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e18e3268-cb2a-436f-8618-ababb7d49ac1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:16.365971 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e18e3268-cb2a-436f-8618-ababb7d49ac1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:16.366425 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-68c1c676-cf6e-4c4b-a7ba-db412aedae01 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:16.366557 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e18e3268-cb2a-436f-8618-ababb7d49ac1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:16.366849 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e18e3268-cb2a-436f-8618-ababb7d49ac1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:16.366954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-68c1c676-cf6e-4c4b-a7ba-db412aedae01 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:16.367365 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-68c1c676-cf6e-4c4b-a7ba-db412aedae01 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:16.368618 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-68c1c676-cf6e-4c4b-a7ba-db412aedae01 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:16.369079 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-68c1c676-cf6e-4c4b-a7ba-db412aedae01 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:16.369587 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-68c1c676-cf6e-4c4b-a7ba-db412aedae01 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:16.387482 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-e18e3268-cb2a-436f-8618-ababb7d49ac1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Getting quotas for project f027aba5a38b422fbc30d64b9ee2ef79. Resources: {'cores', 'instances', 'ram'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:16:16.391626 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-e18e3268-cb2a-436f-8618-ababb7d49ac1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Getting quotas for user abd7bde497c14d25a06c276609aa143f and project f027aba5a38b422fbc30d64b9ee2ef79. Resources: {'cores', 'instances', 'ram'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:16:16.403692 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-e18e3268-cb2a-436f-8618-ababb7d49ac1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Going to run 1 instances... {{(pid=118914) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:16:16.406313 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-e18e3268-cb2a-436f-8618-ababb7d49ac1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 464765b9-dece-4c4b-b84b-9361ad82ac88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4d2e5f3e-4aee-48d2-8ada-0b420d141f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118914) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:16:16.460508 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-e18e3268-cb2a-436f-8618-ababb7d49ac1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510651 Oct 24 13:16:16.461208 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 252/493] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 24 13:16:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:16:16.473870 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-7c7d1a4f-8a24-4955-9a34-8fb098aebb24 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:16.474622 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-7c7d1a4f-8a24-4955-9a34-8fb098aebb24 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 464765b9-dece-4c4b-b84b-9361ad82ac88] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:16.551396 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-7c7d1a4f-8a24-4955-9a34-8fb098aebb24 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:16.559166 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-7c7d1a4f-8a24-4955-9a34-8fb098aebb24 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88" status: 200 len: 1218 microversion: 2.1 time: 0.089485 Oct 24 13:16:16.560052 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 253/494] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:16 2022] GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:16.639838 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-68c1c676-cf6e-4c4b-a7ba-db412aedae01 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:16.648111 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-68c1c676-cf6e-4c4b-a7ba-db412aedae01 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1736 microversion: 2.1 time: 0.292240 Oct 24 13:16:16.648687 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 242/495] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:16 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1736 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:16.711392 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-14d2a3b5-67f8-4d78-bea4-545dbeadc4ad tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:16.715265 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-14d2a3b5-67f8-4d78-bea4-545dbeadc4ad tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:16.723185 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-14d2a3b5-67f8-4d78-bea4-545dbeadc4ad tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:16.723769 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-14d2a3b5-67f8-4d78-bea4-545dbeadc4ad tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:16.724293 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-14d2a3b5-67f8-4d78-bea4-545dbeadc4ad tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:16.725288 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-14d2a3b5-67f8-4d78-bea4-545dbeadc4ad tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:16.725960 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-14d2a3b5-67f8-4d78-bea4-545dbeadc4ad tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:16.726454 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-14d2a3b5-67f8-4d78-bea4-545dbeadc4ad tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:16.768257 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-14d2a3b5-67f8-4d78-bea4-545dbeadc4ad tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062160 Oct 24 13:16:16.769295 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 254/496] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:16:16 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:16:16.966107 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-4de4172c-be1a-4fa5-9226-0be78b72edca tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:16.966824 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-4de4172c-be1a-4fa5-9226-0be78b72edca tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:16.974398 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4de4172c-be1a-4fa5-9226-0be78b72edca tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:16.975035 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4de4172c-be1a-4fa5-9226-0be78b72edca tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:16.975568 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4de4172c-be1a-4fa5-9226-0be78b72edca tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:16.976357 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4de4172c-be1a-4fa5-9226-0be78b72edca tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:16.976913 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4de4172c-be1a-4fa5-9226-0be78b72edca tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:16.977422 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4de4172c-be1a-4fa5-9226-0be78b72edca tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:17.112061 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-4de4172c-be1a-4fa5-9226-0be78b72edca tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:17.119678 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-4de4172c-be1a-4fa5-9226-0be78b72edca tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1546 microversion: 2.1 time: 0.158671 Oct 24 13:16:17.120250 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 243/497] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:16 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:17.144459 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-7e949c30-b256-454b-8720-daf37de3cabf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:17.145189 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-7e949c30-b256-454b-8720-daf37de3cabf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:17.151843 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7e949c30-b256-454b-8720-daf37de3cabf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:17.152324 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7e949c30-b256-454b-8720-daf37de3cabf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:17.152751 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7e949c30-b256-454b-8720-daf37de3cabf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:17.153439 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7e949c30-b256-454b-8720-daf37de3cabf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:17.153885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7e949c30-b256-454b-8720-daf37de3cabf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:17.154299 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7e949c30-b256-454b-8720-daf37de3cabf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:17.158782 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:17.303503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-7e949c30-b256-454b-8720-daf37de3cabf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:17.311803 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-7e949c30-b256-454b-8720-daf37de3cabf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1546 microversion: 2.1 time: 0.171111 Oct 24 13:16:17.312374 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 255/498] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:17 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1546 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:17.334633 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-fdd1fcc0-b79e-44c1-94a1-2f237db39971 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:17.340279 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-fdd1fcc0-b79e-44c1-94a1-2f237db39971 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:17.341038 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-fdd1fcc0-b79e-44c1-94a1-2f237db39971 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Searching by: {'deleted': False, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63'} {{(pid=118915) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 24 13:16:17.347517 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fdd1fcc0-b79e-44c1-94a1-2f237db39971 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:17.348057 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fdd1fcc0-b79e-44c1-94a1-2f237db39971 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:17.348558 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fdd1fcc0-b79e-44c1-94a1-2f237db39971 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:17.349415 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fdd1fcc0-b79e-44c1-94a1-2f237db39971 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:17.349868 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fdd1fcc0-b79e-44c1-94a1-2f237db39971 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:17.350286 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fdd1fcc0-b79e-44c1-94a1-2f237db39971 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:17.443789 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.multi_cell_list [None req-fdd1fcc0-b79e-44c1-94a1-2f237db39971 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118915) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 24 13:16:17.541233 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-fdd1fcc0-b79e-44c1-94a1-2f237db39971 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.210385 Oct 24 13:16:17.541813 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 244/499] 10.222.0.42 () {58 vars in 1125 bytes} [Mon Oct 24 13:16:17 2022] GET /compute/v2.1/servers => generated 342 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:16:17.553475 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c7e7315f-858a-45a4-a198-0c458b6bb55d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:17.554127 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-c7e7315f-858a-45a4-a198-0c458b6bb55d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:17.561114 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c7e7315f-858a-45a4-a198-0c458b6bb55d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:17.561620 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c7e7315f-858a-45a4-a198-0c458b6bb55d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:17.562057 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c7e7315f-858a-45a4-a198-0c458b6bb55d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:17.562748 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c7e7315f-858a-45a4-a198-0c458b6bb55d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:17.563272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c7e7315f-858a-45a4-a198-0c458b6bb55d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:17.563728 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c7e7315f-858a-45a4-a198-0c458b6bb55d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:17.582514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-dae079b4-8c00-4a6b-bb3c-ecb2bf8d340e tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:17.583193 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-dae079b4-8c00-4a6b-bb3c-ecb2bf8d340e tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 464765b9-dece-4c4b-b84b-9361ad82ac88] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:17.589196 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dae079b4-8c00-4a6b-bb3c-ecb2bf8d340e tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:17.589675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dae079b4-8c00-4a6b-bb3c-ecb2bf8d340e tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:17.590141 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dae079b4-8c00-4a6b-bb3c-ecb2bf8d340e tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:17.590833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dae079b4-8c00-4a6b-bb3c-ecb2bf8d340e tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:17.591311 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dae079b4-8c00-4a6b-bb3c-ecb2bf8d340e tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:17.591732 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dae079b4-8c00-4a6b-bb3c-ecb2bf8d340e tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:17.654317 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-dae079b4-8c00-4a6b-bb3c-ecb2bf8d340e tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:17.662243 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-dae079b4-8c00-4a6b-bb3c-ecb2bf8d340e tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88" status: 200 len: 1270 microversion: 2.1 time: 0.083493 Oct 24 13:16:17.662831 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 245/500] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:17 2022] GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88 => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:17.678162 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-346ee820-e423-44ff-892d-0c77ccd3fef3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:17.679728 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-346ee820-e423-44ff-892d-0c77ccd3fef3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:17.686597 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-346ee820-e423-44ff-892d-0c77ccd3fef3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:17.687105 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-346ee820-e423-44ff-892d-0c77ccd3fef3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:17.687541 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-346ee820-e423-44ff-892d-0c77ccd3fef3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:17.688235 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-346ee820-e423-44ff-892d-0c77ccd3fef3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:17.688684 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-346ee820-e423-44ff-892d-0c77ccd3fef3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:17.689107 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-346ee820-e423-44ff-892d-0c77ccd3fef3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:17.704450 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-c7e7315f-858a-45a4-a198-0c458b6bb55d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:17.714240 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-c7e7315f-858a-45a4-a198-0c458b6bb55d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1546 microversion: 2.1 time: 0.164716 Oct 24 13:16:17.715198 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 256/501] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:17 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1546 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:17.784498 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-ae20ca03-187b-42b3-a1c9-c5d7b7806d39 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:17.790241 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-ae20ca03-187b-42b3-a1c9-c5d7b7806d39 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:17.799086 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ae20ca03-187b-42b3-a1c9-c5d7b7806d39 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:17.800277 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ae20ca03-187b-42b3-a1c9-c5d7b7806d39 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:17.800980 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ae20ca03-187b-42b3-a1c9-c5d7b7806d39 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:17.802057 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ae20ca03-187b-42b3-a1c9-c5d7b7806d39 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:17.802683 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ae20ca03-187b-42b3-a1c9-c5d7b7806d39 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:17.803205 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ae20ca03-187b-42b3-a1c9-c5d7b7806d39 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:17.843006 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-ae20ca03-187b-42b3-a1c9-c5d7b7806d39 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063034 Oct 24 13:16:17.851037 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 257/502] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:16:17 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:16:17.935087 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-9a1316bd-d135-4bec-930f-e7cfd863ae24 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:17.936081 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-9a1316bd-d135-4bec-930f-e7cfd863ae24 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:17.943902 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9a1316bd-d135-4bec-930f-e7cfd863ae24 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:17.944737 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9a1316bd-d135-4bec-930f-e7cfd863ae24 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:17.945407 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-346ee820-e423-44ff-892d-0c77ccd3fef3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:17.948280 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9a1316bd-d135-4bec-930f-e7cfd863ae24 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:17.949511 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9a1316bd-d135-4bec-930f-e7cfd863ae24 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:17.950431 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9a1316bd-d135-4bec-930f-e7cfd863ae24 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:17.951425 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9a1316bd-d135-4bec-930f-e7cfd863ae24 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:17.956583 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-346ee820-e423-44ff-892d-0c77ccd3fef3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1736 microversion: 2.1 time: 0.288380 Oct 24 13:16:17.983970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-9a1316bd-d135-4bec-930f-e7cfd863ae24 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Going to try to terminate instance {{(pid=118914) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:16:17.986456 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 246/503] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:17 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1736 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:18.084682 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-9a1316bd-d135-4bec-930f-e7cfd863ae24 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b" status: 204 len: 0 microversion: 2.1 time: 0.156602 Oct 24 13:16:18.085365 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 258/504] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:16:17 2022] DELETE /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:16:18.094345 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-0721fdfb-9f29-46a7-9ed7-a867ea6158f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:18.095276 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-0721fdfb-9f29-46a7-9ed7-a867ea6158f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:18.103822 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0721fdfb-9f29-46a7-9ed7-a867ea6158f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:18.104667 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0721fdfb-9f29-46a7-9ed7-a867ea6158f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:18.105103 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0721fdfb-9f29-46a7-9ed7-a867ea6158f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:18.106478 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0721fdfb-9f29-46a7-9ed7-a867ea6158f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:18.107189 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0721fdfb-9f29-46a7-9ed7-a867ea6158f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:18.108823 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0721fdfb-9f29-46a7-9ed7-a867ea6158f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:18.139241 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=100 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:18.579895 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-0721fdfb-9f29-46a7-9ed7-a867ea6158f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:18.588817 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-0721fdfb-9f29-46a7-9ed7-a867ea6158f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b" status: 200 len: 1682 microversion: 2.1 time: 0.498422 Oct 24 13:16:18.589385 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 247/505] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:18 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b => generated 1682 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:18.686994 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-ae15ee68-c5ee-4e86-a026-6ee898a04e57 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:18.687717 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-ae15ee68-c5ee-4e86-a026-6ee898a04e57 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 464765b9-dece-4c4b-b84b-9361ad82ac88] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:18.693608 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ae15ee68-c5ee-4e86-a026-6ee898a04e57 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:18.694085 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ae15ee68-c5ee-4e86-a026-6ee898a04e57 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:18.694513 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ae15ee68-c5ee-4e86-a026-6ee898a04e57 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:18.695222 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ae15ee68-c5ee-4e86-a026-6ee898a04e57 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:18.695669 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ae15ee68-c5ee-4e86-a026-6ee898a04e57 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:18.696632 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ae15ee68-c5ee-4e86-a026-6ee898a04e57 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:18.759823 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-ae15ee68-c5ee-4e86-a026-6ee898a04e57 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:18.768171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-ae15ee68-c5ee-4e86-a026-6ee898a04e57 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88" status: 200 len: 1276 microversion: 2.1 time: 0.085386 Oct 24 13:16:18.768763 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 259/506] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:18 2022] GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88 => generated 1276 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:18.985928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9091db9a-8d5e-40e2-8b84-40a40c0b948d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:18.986538 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9091db9a-8d5e-40e2-8b84-40a40c0b948d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:18.988413 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:18.994299 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9091db9a-8d5e-40e2-8b84-40a40c0b948d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:18.994784 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9091db9a-8d5e-40e2-8b84-40a40c0b948d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:18.995278 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9091db9a-8d5e-40e2-8b84-40a40c0b948d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:18.995967 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9091db9a-8d5e-40e2-8b84-40a40c0b948d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:18.996419 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9091db9a-8d5e-40e2-8b84-40a40c0b948d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:18.996840 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9091db9a-8d5e-40e2-8b84-40a40c0b948d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:19.135714 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-9091db9a-8d5e-40e2-8b84-40a40c0b948d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:19.144815 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-9091db9a-8d5e-40e2-8b84-40a40c0b948d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1736 microversion: 2.1 time: 0.162635 Oct 24 13:16:19.145547 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 248/507] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:18 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:19.370316 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-7c4c2bd7-fbfd-41c2-9ef6-4209315b9d6c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07d88c15-4a24-4bc5-81d9-cd0a56122e17"}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:19.372659 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-7c4c2bd7-fbfd-41c2-9ef6-4209315b9d6c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:19.379064 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7c4c2bd7-fbfd-41c2-9ef6-4209315b9d6c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:19.379566 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7c4c2bd7-fbfd-41c2-9ef6-4209315b9d6c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:19.380001 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7c4c2bd7-fbfd-41c2-9ef6-4209315b9d6c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:19.380684 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7c4c2bd7-fbfd-41c2-9ef6-4209315b9d6c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:19.381135 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7c4c2bd7-fbfd-41c2-9ef6-4209315b9d6c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:19.381559 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7c4c2bd7-fbfd-41c2-9ef6-4209315b9d6c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:19.613328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-4a3f5136-e089-46d3-859a-49ea7988b525 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:19.613973 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-4a3f5136-e089-46d3-859a-49ea7988b525 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:19.620526 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4a3f5136-e089-46d3-859a-49ea7988b525 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:19.621257 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4a3f5136-e089-46d3-859a-49ea7988b525 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:19.621878 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4a3f5136-e089-46d3-859a-49ea7988b525 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:19.622567 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4a3f5136-e089-46d3-859a-49ea7988b525 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:19.623264 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4a3f5136-e089-46d3-859a-49ea7988b525 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:19.623689 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4a3f5136-e089-46d3-859a-49ea7988b525 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:19.749862 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-7c4c2bd7-fbfd-41c2-9ef6-4209315b9d6c tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "POST /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.383500 Oct 24 13:16:19.759274 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 260/508] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 24 13:16:19 2022] POST /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4/os-volume_attachments => generated 194 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:16:19.793973 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-ce36e29e-e817-43d9-92ce-39fd4d58d3f4 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:19.794733 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-ce36e29e-e817-43d9-92ce-39fd4d58d3f4 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 464765b9-dece-4c4b-b84b-9361ad82ac88] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:19.801584 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ce36e29e-e817-43d9-92ce-39fd4d58d3f4 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:19.802072 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ce36e29e-e817-43d9-92ce-39fd4d58d3f4 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:19.802495 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ce36e29e-e817-43d9-92ce-39fd4d58d3f4 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:19.803217 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ce36e29e-e817-43d9-92ce-39fd4d58d3f4 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:19.803682 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ce36e29e-e817-43d9-92ce-39fd4d58d3f4 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:19.804412 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ce36e29e-e817-43d9-92ce-39fd4d58d3f4 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:19.904946 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-4a3f5136-e089-46d3-859a-49ea7988b525 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:19.915466 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-4a3f5136-e089-46d3-859a-49ea7988b525 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b" status: 200 len: 1682 microversion: 2.1 time: 0.305314 Oct 24 13:16:19.916559 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 249/509] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:19 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b => generated 1682 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:19.955175 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-ce36e29e-e817-43d9-92ce-39fd4d58d3f4 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:19.963205 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-ce36e29e-e817-43d9-92ce-39fd4d58d3f4 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88" status: 200 len: 1318 microversion: 2.1 time: 0.174875 Oct 24 13:16:19.963776 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 261/510] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:19 2022] GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:20.169669 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-f49d5253-f3db-4be3-9c8c-23da9c85a640 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:20.170449 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-f49d5253-f3db-4be3-9c8c-23da9c85a640 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:20.177254 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f49d5253-f3db-4be3-9c8c-23da9c85a640 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:20.177679 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f49d5253-f3db-4be3-9c8c-23da9c85a640 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:20.178110 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f49d5253-f3db-4be3-9c8c-23da9c85a640 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:20.178806 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f49d5253-f3db-4be3-9c8c-23da9c85a640 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:20.179285 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f49d5253-f3db-4be3-9c8c-23da9c85a640 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:20.179707 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f49d5253-f3db-4be3-9c8c-23da9c85a640 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:20.503896 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-f49d5253-f3db-4be3-9c8c-23da9c85a640 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:20.512999 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-f49d5253-f3db-4be3-9c8c-23da9c85a640 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1736 microversion: 2.1 time: 0.347178 Oct 24 13:16:20.513566 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 250/511] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:20 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1736 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:20.803400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-0d07934a-5d4e-4d29-b186-6dd4c38cbea3 req-c143af22-9326-412d-8188-c42d8c8658bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "464765b9-dece-4c4b-b84b-9361ad82ac88", "tag": "3a4966df-5594-432c-b7ff-77cf8ebddc41"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:20.814145 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-0d07934a-5d4e-4d29-b186-6dd4c38cbea3 req-c143af22-9326-412d-8188-c42d8c8658bb service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:20.814705 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-0d07934a-5d4e-4d29-b186-6dd4c38cbea3 req-c143af22-9326-412d-8188-c42d8c8658bb service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:20.815243 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-0d07934a-5d4e-4d29-b186-6dd4c38cbea3 req-c143af22-9326-412d-8188-c42d8c8658bb service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:20.826544 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-0d07934a-5d4e-4d29-b186-6dd4c38cbea3 req-c143af22-9326-412d-8188-c42d8c8658bb service nova] Creating event network-changed:3a4966df-5594-432c-b7ff-77cf8ebddc41 for instance 464765b9-dece-4c4b-b84b-9361ad82ac88 on hv-cinder-86248 Oct 24 13:16:20.831562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-0d07934a-5d4e-4d29-b186-6dd4c38cbea3 req-c143af22-9326-412d-8188-c42d8c8658bb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032079 Oct 24 13:16:20.832249 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 262/512] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:16:20.941562 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-b6f25a10-5573-485e-881e-d74a465f65a3 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:20.942302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-b6f25a10-5573-485e-881e-d74a465f65a3 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:20.948980 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b6f25a10-5573-485e-881e-d74a465f65a3 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:20.949455 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b6f25a10-5573-485e-881e-d74a465f65a3 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:20.949891 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b6f25a10-5573-485e-881e-d74a465f65a3 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:20.950571 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b6f25a10-5573-485e-881e-d74a465f65a3 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:20.951028 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b6f25a10-5573-485e-881e-d74a465f65a3 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:20.951458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b6f25a10-5573-485e-881e-d74a465f65a3 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:20.986039 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-91240e61-2c59-4014-8ee2-7fead5c65623 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:20.986643 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-91240e61-2c59-4014-8ee2-7fead5c65623 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 464765b9-dece-4c4b-b84b-9361ad82ac88] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:20.993675 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-91240e61-2c59-4014-8ee2-7fead5c65623 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:20.994208 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-91240e61-2c59-4014-8ee2-7fead5c65623 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:20.994634 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-91240e61-2c59-4014-8ee2-7fead5c65623 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:20.995342 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-91240e61-2c59-4014-8ee2-7fead5c65623 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:20.995798 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-91240e61-2c59-4014-8ee2-7fead5c65623 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:20.996204 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-91240e61-2c59-4014-8ee2-7fead5c65623 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:21.130101 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-91240e61-2c59-4014-8ee2-7fead5c65623 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:21.139793 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-91240e61-2c59-4014-8ee2-7fead5c65623 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88" status: 200 len: 1318 microversion: 2.1 time: 0.157809 Oct 24 13:16:21.140367 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 263/513] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:20 2022] GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:21.232918 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-b6f25a10-5573-485e-881e-d74a465f65a3 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:21.242034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-b6f25a10-5573-485e-881e-d74a465f65a3 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b" status: 200 len: 1682 microversion: 2.1 time: 0.304246 Oct 24 13:16:21.242633 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 251/514] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:20 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b => generated 1682 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:21.538491 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-e6b0bc77-7dc7-4bba-adca-49e465cd10ce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:21.539017 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-e6b0bc77-7dc7-4bba-adca-49e465cd10ce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:21.546108 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e6b0bc77-7dc7-4bba-adca-49e465cd10ce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:21.546592 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e6b0bc77-7dc7-4bba-adca-49e465cd10ce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:21.547018 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e6b0bc77-7dc7-4bba-adca-49e465cd10ce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:21.547727 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e6b0bc77-7dc7-4bba-adca-49e465cd10ce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:21.548174 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e6b0bc77-7dc7-4bba-adca-49e465cd10ce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:21.548588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e6b0bc77-7dc7-4bba-adca-49e465cd10ce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:21.696313 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-e6b0bc77-7dc7-4bba-adca-49e465cd10ce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:21.710154 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-e6b0bc77-7dc7-4bba-adca-49e465cd10ce tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1736 microversion: 2.1 time: 0.175478 Oct 24 13:16:21.710971 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 264/515] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:21 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:22.161738 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-2c7a6735-e77a-47d1-825c-da512cd84619 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:22.162354 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-2c7a6735-e77a-47d1-825c-da512cd84619 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 464765b9-dece-4c4b-b84b-9361ad82ac88] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:22.168390 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c7a6735-e77a-47d1-825c-da512cd84619 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:22.168876 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c7a6735-e77a-47d1-825c-da512cd84619 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:22.169340 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c7a6735-e77a-47d1-825c-da512cd84619 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:22.170035 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c7a6735-e77a-47d1-825c-da512cd84619 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:22.170496 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c7a6735-e77a-47d1-825c-da512cd84619 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:22.170922 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c7a6735-e77a-47d1-825c-da512cd84619 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:22.267303 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-122fa6ad-3e3b-4bbe-b474-06e31b5d5031 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:22.267918 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-122fa6ad-3e3b-4bbe-b474-06e31b5d5031 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:22.274059 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-122fa6ad-3e3b-4bbe-b474-06e31b5d5031 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:22.275476 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-122fa6ad-3e3b-4bbe-b474-06e31b5d5031 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:22.275719 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-122fa6ad-3e3b-4bbe-b474-06e31b5d5031 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:22.276424 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-122fa6ad-3e3b-4bbe-b474-06e31b5d5031 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:22.276878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-122fa6ad-3e3b-4bbe-b474-06e31b5d5031 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:22.277301 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-122fa6ad-3e3b-4bbe-b474-06e31b5d5031 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:22.309276 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-2c7a6735-e77a-47d1-825c-da512cd84619 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:22.318862 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-2c7a6735-e77a-47d1-825c-da512cd84619 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88" status: 200 len: 1318 microversion: 2.1 time: 0.160905 Oct 24 13:16:22.319887 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 252/516] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:22 2022] GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:22.350597 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-122fa6ad-3e3b-4bbe-b474-06e31b5d5031 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:22.358966 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-122fa6ad-3e3b-4bbe-b474-06e31b5d5031 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b" status: 200 len: 1615 microversion: 2.1 time: 0.095540 Oct 24 13:16:22.359606 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 265/517] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:22 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b => generated 1615 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:22.733612 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-29b93249-27af-4659-af3e-302e5dcb54af tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:22.734218 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-29b93249-27af-4659-af3e-302e5dcb54af tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:22.740010 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-29b93249-27af-4659-af3e-302e5dcb54af tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:22.740484 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-29b93249-27af-4659-af3e-302e5dcb54af tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:22.740911 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-29b93249-27af-4659-af3e-302e5dcb54af tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:22.741642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-29b93249-27af-4659-af3e-302e5dcb54af tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:22.742115 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-29b93249-27af-4659-af3e-302e5dcb54af tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:22.743404 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-29b93249-27af-4659-af3e-302e5dcb54af tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:22.866314 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-b5e0ff57-e3a3-45e8-bea4-57a8bf867fb0 req-7c58ec62-9758-4430-9238-1a09ceb978f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d11b9d-5ddc-4747-9632-d652e6c93b7b", "name": "network-vif-deleted", "tag": "3279f147-249f-4187-bbc4-6ce7f6ef81c1"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:22.878424 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-b5e0ff57-e3a3-45e8-bea4-57a8bf867fb0 req-7c58ec62-9758-4430-9238-1a09ceb978f6 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:22.878928 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-b5e0ff57-e3a3-45e8-bea4-57a8bf867fb0 req-7c58ec62-9758-4430-9238-1a09ceb978f6 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:22.879512 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-b5e0ff57-e3a3-45e8-bea4-57a8bf867fb0 req-7c58ec62-9758-4430-9238-1a09ceb978f6 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:22.891009 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-b5e0ff57-e3a3-45e8-bea4-57a8bf867fb0 req-7c58ec62-9758-4430-9238-1a09ceb978f6 service nova] Creating event network-vif-deleted:3279f147-249f-4187-bbc4-6ce7f6ef81c1 for instance b0d11b9d-5ddc-4747-9632-d652e6c93b7b on hv-cinder-86248 Oct 24 13:16:22.895979 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-b5e0ff57-e3a3-45e8-bea4-57a8bf867fb0 req-7c58ec62-9758-4430-9238-1a09ceb978f6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033494 Oct 24 13:16:22.896630 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 266/518] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:16:22.941472 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-29b93249-27af-4659-af3e-302e5dcb54af tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:22.951345 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-29b93249-27af-4659-af3e-302e5dcb54af tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1736 microversion: 2.1 time: 0.221416 Oct 24 13:16:22.964221 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 253/519] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:22 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:23.343369 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-38c50df6-6602-4f10-8df9-6f1a21cb4ed1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:23.344076 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-38c50df6-6602-4f10-8df9-6f1a21cb4ed1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 464765b9-dece-4c4b-b84b-9361ad82ac88] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:23.350187 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-38c50df6-6602-4f10-8df9-6f1a21cb4ed1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:23.350677 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-38c50df6-6602-4f10-8df9-6f1a21cb4ed1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:23.351250 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-38c50df6-6602-4f10-8df9-6f1a21cb4ed1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:23.351991 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-38c50df6-6602-4f10-8df9-6f1a21cb4ed1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:23.353001 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-38c50df6-6602-4f10-8df9-6f1a21cb4ed1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:23.353429 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-38c50df6-6602-4f10-8df9-6f1a21cb4ed1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:23.382119 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-46351690-554a-4251-b617-fc957e1ac815 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:23.384466 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-46351690-554a-4251-b617-fc957e1ac815 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:23.391905 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-46351690-554a-4251-b617-fc957e1ac815 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:23.392581 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-46351690-554a-4251-b617-fc957e1ac815 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:23.393445 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-46351690-554a-4251-b617-fc957e1ac815 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:23.394341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-46351690-554a-4251-b617-fc957e1ac815 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:23.395082 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-46351690-554a-4251-b617-fc957e1ac815 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:23.395652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-46351690-554a-4251-b617-fc957e1ac815 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:23.414096 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-46351690-554a-4251-b617-fc957e1ac815 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] HTTP exception thrown: Instance b0d11b9d-5ddc-4747-9632-d652e6c93b7b could not be found. Oct 24 13:16:23.417091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-46351690-554a-4251-b617-fc957e1ac815 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Request method failure captured: Oct 24 13:16:23.417091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b HTTP/1.1 Oct 24 13:16:23.417091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:16:23.417091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:16:23.417091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:16:23.417091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:16:23.417091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:16:23.417091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:16:23.417091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:16:23.417091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:16:23.417091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo9AXwMG0aRbejat92eCxhMJFSv0y7_lNyhuCUN6zXnDHpFGdG48-ggi2-Do-PEfXVv_XARCMCP2kZbyq19slbwuuFeg54REDqUjfIH_fbN8NXKvJLHQXv8L_GOaWATBtTB6QuD_0kWnm_UJtW2Xnio6IxEqQIshhCCIfC1pGYUCOsE Oct 24 13:16:23.417091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:16:23.417091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:16:23.417091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:16:23.417091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:16:23.417091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:16:23.417091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:16:23.417091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:16:23.417091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:16:23.417091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:16:23.417091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:16:23.418767 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:16:23.418767 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:16:23.418767 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:16:23.418767 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:16:23.418767 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:16:23.418767 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:16:23.418767 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:16:23.418767 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: c5619c8183e04e1d9073f1b40e057967 Oct 24 13:16:23.418767 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:16:23.418767 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:16:23.418767 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Instance b0d11b9d-5ddc-4747-9632-d652e6c93b7b could not be found. Oct 24 13:16:23.418767 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': 'b0d11b9d-5ddc-4747-9632-d652e6c93b7b'} Oct 24 13:16:23.419671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:16:23.419671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:16:23.419671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:16:23.419671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:16:23.419671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:16:23.419671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:16:23.419671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:16:23.419671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:16:23.419671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:16:23.419671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:16:23.419671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0d11b9d-5ddc-4747-9632-d652e6c93b7b could not be found. Oct 24 13:16:23.419671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:16:23.419671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:16:23.419671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:16:23.419671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:16:23.419671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:16:23.419671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:16:23.419671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:16:23.419671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:16:23.419671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:16:23.421094 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:16:23.421094 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:16:23.421094 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:16:23.421094 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:16:23.421094 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:16:23.421094 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:16:23.421094 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:16:23.421094 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0d11b9d-5ddc-4747-9632-d652e6c93b7b could not be found. Oct 24 13:16:23.421094 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:16:23.421094 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:16:23.421094 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:16:23.421094 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:16:23.421094 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:16:23.421094 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:16:23.421094 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:16:23.421094 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:16:23.421094 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0d11b9d-5ddc-4747-9632-d652e6c93b7b could not be found. Oct 24 13:16:23.421094 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:16:23.422991 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-46351690-554a-4251-b617-fc957e1ac815 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Returning 404 to user: Instance b0d11b9d-5ddc-4747-9632-d652e6c93b7b could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:16:23.423877 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-46351690-554a-4251-b617-fc957e1ac815 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b" status: 404 len: 111 microversion: 2.1 time: 0.046013 Oct 24 13:16:23.427855 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 254/520] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:23 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:16:23.433219 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-b22df49a-00f3-4b1f-aa28-cfe637fb5058 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '.version_select at 0x7fad286105e0>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:23.453048 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-b22df49a-00f3-4b1f-aa28-cfe637fb5058 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1141128944" status: 202 len: 0 microversion: 2.1 time: 0.024085 Oct 24 13:16:23.453625 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 255/521] 10.222.0.42 () {58 vars in 1221 bytes} [Mon Oct 24 13:16:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1141128944 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 13:16:23.499439 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-38c50df6-6602-4f10-8df9-6f1a21cb4ed1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:23.507095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-38c50df6-6602-4f10-8df9-6f1a21cb4ed1 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88" status: 200 len: 1318 microversion: 2.1 time: 0.167917 Oct 24 13:16:23.507661 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 267/522] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:23 2022] GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:23.975678 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-f1bc2db9-ec33-405c-9110-e65202d5b502 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:23.976381 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-f1bc2db9-ec33-405c-9110-e65202d5b502 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:23.983646 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f1bc2db9-ec33-405c-9110-e65202d5b502 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:23.984125 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f1bc2db9-ec33-405c-9110-e65202d5b502 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:23.984554 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f1bc2db9-ec33-405c-9110-e65202d5b502 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:23.985244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f1bc2db9-ec33-405c-9110-e65202d5b502 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:23.985694 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f1bc2db9-ec33-405c-9110-e65202d5b502 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:23.986115 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f1bc2db9-ec33-405c-9110-e65202d5b502 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:24.121202 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-f1bc2db9-ec33-405c-9110-e65202d5b502 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:24.129603 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-f1bc2db9-ec33-405c-9110-e65202d5b502 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1736 microversion: 2.1 time: 0.158108 Oct 24 13:16:24.130161 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 256/523] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:23 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:24.347546 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-066665b4-c58b-4eb0-a3a2-79c2b428cfd7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Action: 'create', calling method: .version_select at 0x7fad2864c040>, body: {"keypair": {"name": "tempest-keypair-317416502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpHhMxngDMOj6fDo9rW2Pdrxt3pEy33UdA+EcvWYQbeIWyAOUC1Hkzv1pOmkkxFFtAt2l2f5IDtWcOSXme5hwr7tJRUraK662mvQyOq0YgC0xcHNpsyH5LDqayct+2ZFA=="}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:24.363769 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-066665b4-c58b-4eb0-a3a2-79c2b428cfd7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Getting quotas for project 69beb82dd21b447d8a784e0570c4323c. Resources: {'key_pairs'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:16:24.367472 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-066665b4-c58b-4eb0-a3a2-79c2b428cfd7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Getting quotas for user c5619c8183e04e1d9073f1b40e057967 and project 69beb82dd21b447d8a784e0570c4323c. Resources: {'key_pairs'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:16:24.389283 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-066665b4-c58b-4eb0-a3a2-79c2b428cfd7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045823 Oct 24 13:16:24.389874 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 268/524] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Oct 24 13:16:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:16:24.530820 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-fecea31b-fd72-443f-8ab5-c5c6e43b0c0e tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:24.532561 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-fecea31b-fd72-443f-8ab5-c5c6e43b0c0e tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 464765b9-dece-4c4b-b84b-9361ad82ac88] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:24.540630 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fecea31b-fd72-443f-8ab5-c5c6e43b0c0e tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:24.540830 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fecea31b-fd72-443f-8ab5-c5c6e43b0c0e tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:24.541096 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fecea31b-fd72-443f-8ab5-c5c6e43b0c0e tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:24.541783 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fecea31b-fd72-443f-8ab5-c5c6e43b0c0e tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:24.542233 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fecea31b-fd72-443f-8ab5-c5c6e43b0c0e tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:24.542710 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fecea31b-fd72-443f-8ab5-c5c6e43b0c0e tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:24.702136 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-fecea31b-fd72-443f-8ab5-c5c6e43b0c0e tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:24.710282 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-fecea31b-fd72-443f-8ab5-c5c6e43b0c0e tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88" status: 200 len: 1318 microversion: 2.1 time: 0.183483 Oct 24 13:16:24.710880 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 257/525] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:24 2022] GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:25.154096 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a02cc3ea-c4ee-4a4b-8481-17aa5a82308d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:25.154712 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a02cc3ea-c4ee-4a4b-8481-17aa5a82308d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:25.160698 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a02cc3ea-c4ee-4a4b-8481-17aa5a82308d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:25.161185 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a02cc3ea-c4ee-4a4b-8481-17aa5a82308d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:25.161625 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a02cc3ea-c4ee-4a4b-8481-17aa5a82308d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:25.162316 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a02cc3ea-c4ee-4a4b-8481-17aa5a82308d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:25.162774 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a02cc3ea-c4ee-4a4b-8481-17aa5a82308d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:25.163291 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a02cc3ea-c4ee-4a4b-8481-17aa5a82308d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:25.318445 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a02cc3ea-c4ee-4a4b-8481-17aa5a82308d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:25.326870 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a02cc3ea-c4ee-4a4b-8481-17aa5a82308d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1736 microversion: 2.1 time: 0.176678 Oct 24 13:16:25.327532 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 269/526] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:25 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:25.710833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-64bde9d4-afa4-4cb6-bf9c-2082b9547638 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-826366725", "imageRef": "4d2e5f3e-4aee-48d2-8ada-0b420d141f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a05f0bd2-3e3c-4265-bb55-173e62bd1853"}], "security_groups": [{"name": "tempest-securitygroup--1099683771"}], "key_name": "tempest-keypair-317416502", "user_data": "}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:25.733943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d84aac99-c301-47ca-bb2f-f5731f3f3663 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:25.734554 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-d84aac99-c301-47ca-bb2f-f5731f3f3663 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 464765b9-dece-4c4b-b84b-9361ad82ac88] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:25.740979 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d84aac99-c301-47ca-bb2f-f5731f3f3663 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:25.741459 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d84aac99-c301-47ca-bb2f-f5731f3f3663 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:25.741894 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d84aac99-c301-47ca-bb2f-f5731f3f3663 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:25.742584 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d84aac99-c301-47ca-bb2f-f5731f3f3663 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:25.743686 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d84aac99-c301-47ca-bb2f-f5731f3f3663 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:25.744201 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d84aac99-c301-47ca-bb2f-f5731f3f3663 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:25.820400 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.network.neutron [None req-64bde9d4-afa4-4cb6-bf9c-2082b9547638 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] validate_networks() for [('a05f0bd2-3e3c-4265-bb55-173e62bd1853', None, None, None, None, None)] {{(pid=118915) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:16:25.891624 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-d84aac99-c301-47ca-bb2f-f5731f3f3663 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:25.899444 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-d84aac99-c301-47ca-bb2f-f5731f3f3663 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88" status: 200 len: 1318 microversion: 2.1 time: 0.169287 Oct 24 13:16:25.900214 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 270/527] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:25 2022] GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:26.231546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-64bde9d4-afa4-4cb6-bf9c-2082b9547638 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Flavor limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:16:26.231967 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-64bde9d4-afa4-4cb6-bf9c-2082b9547638 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Image limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:16:26.232441 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-64bde9d4-afa4-4cb6-bf9c-2082b9547638 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Flavor pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:16:26.232848 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-64bde9d4-afa4-4cb6-bf9c-2082b9547638 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Image pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:16:26.233257 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-64bde9d4-afa4-4cb6-bf9c-2082b9547638 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:16:26.248435 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-64bde9d4-afa4-4cb6-bf9c-2082b9547638 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:26.248980 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-64bde9d4-afa4-4cb6-bf9c-2082b9547638 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:26.249408 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-64bde9d4-afa4-4cb6-bf9c-2082b9547638 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:26.250181 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-64bde9d4-afa4-4cb6-bf9c-2082b9547638 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:26.250629 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-64bde9d4-afa4-4cb6-bf9c-2082b9547638 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:26.251048 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-64bde9d4-afa4-4cb6-bf9c-2082b9547638 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:26.268766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-64bde9d4-afa4-4cb6-bf9c-2082b9547638 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Getting quotas for project 69beb82dd21b447d8a784e0570c4323c. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:16:26.272597 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-64bde9d4-afa4-4cb6-bf9c-2082b9547638 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Getting quotas for user c5619c8183e04e1d9073f1b40e057967 and project 69beb82dd21b447d8a784e0570c4323c. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:16:26.284350 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-64bde9d4-afa4-4cb6-bf9c-2082b9547638 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Going to run 1 instances... {{(pid=118915) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:16:26.286648 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-64bde9d4-afa4-4cb6-bf9c-2082b9547638 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4d2e5f3e-4aee-48d2-8ada-0b420d141f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:16:26.333743 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-64bde9d4-afa4-4cb6-bf9c-2082b9547638 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.627251 Oct 24 13:16:26.334381 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 258/528] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 24 13:16:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:16:26.346251 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-594b73f3-e8fb-46c2-ba94-5b3600e77d19 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:26.346860 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-594b73f3-e8fb-46c2-ba94-5b3600e77d19 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:26.350846 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-f2f98f8f-9ae6-4d43-9191-ccb4d2aaba59 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:26.351617 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-f2f98f8f-9ae6-4d43-9191-ccb4d2aaba59 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:26.359256 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f2f98f8f-9ae6-4d43-9191-ccb4d2aaba59 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:26.359839 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f2f98f8f-9ae6-4d43-9191-ccb4d2aaba59 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:26.360555 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f2f98f8f-9ae6-4d43-9191-ccb4d2aaba59 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:26.361335 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f2f98f8f-9ae6-4d43-9191-ccb4d2aaba59 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:26.361882 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f2f98f8f-9ae6-4d43-9191-ccb4d2aaba59 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:26.362403 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f2f98f8f-9ae6-4d43-9191-ccb4d2aaba59 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:26.374927 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=2 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:26.409056 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-594b73f3-e8fb-46c2-ba94-5b3600e77d19 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:26.419167 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-594b73f3-e8fb-46c2-ba94-5b3600e77d19 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5" status: 200 len: 1240 microversion: 2.1 time: 0.076633 Oct 24 13:16:26.428148 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 271/529] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:26 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:26.526492 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-f2f98f8f-9ae6-4d43-9191-ccb4d2aaba59 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:26.535418 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-f2f98f8f-9ae6-4d43-9191-ccb4d2aaba59 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1736 microversion: 2.1 time: 0.188310 Oct 24 13:16:26.536272 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 259/530] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:26 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:26.851532 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-561c9f9d-3276-44d2-997b-3ac90ac96623 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:26.852640 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-561c9f9d-3276-44d2-997b-3ac90ac96623 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:26.859629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-561c9f9d-3276-44d2-997b-3ac90ac96623 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:26.860108 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-561c9f9d-3276-44d2-997b-3ac90ac96623 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:26.860535 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-561c9f9d-3276-44d2-997b-3ac90ac96623 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:26.861221 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-561c9f9d-3276-44d2-997b-3ac90ac96623 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:26.861680 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-561c9f9d-3276-44d2-997b-3ac90ac96623 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:26.862078 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-561c9f9d-3276-44d2-997b-3ac90ac96623 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:26.865877 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:26.923702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-06925e96-d6b2-4929-ab6e-1d8c0c00d66a tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:26.924592 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-06925e96-d6b2-4929-ab6e-1d8c0c00d66a tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 464765b9-dece-4c4b-b84b-9361ad82ac88] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:26.932330 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-06925e96-d6b2-4929-ab6e-1d8c0c00d66a tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:26.932815 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-06925e96-d6b2-4929-ab6e-1d8c0c00d66a tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:26.933661 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-06925e96-d6b2-4929-ab6e-1d8c0c00d66a tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:26.934740 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-06925e96-d6b2-4929-ab6e-1d8c0c00d66a tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:26.935273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-06925e96-d6b2-4929-ab6e-1d8c0c00d66a tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:26.936135 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-06925e96-d6b2-4929-ab6e-1d8c0c00d66a tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:26.958218 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.objects.instance [None req-561c9f9d-3276-44d2-997b-3ac90ac96623 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lazy-loading 'services' on Instance uuid 29f8f878-fe8d-4dd0-9478-268c08885faf {{(pid=118914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:16:27.047868 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-561c9f9d-3276-44d2-997b-3ac90ac96623 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "DELETE /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf/os-volume_attachments/38f7dd8f-43f4-4a40-a488-a5d0661b891b" status: 202 len: 0 microversion: 2.1 time: 0.200149 Oct 24 13:16:27.048456 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 272/531] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 24 13:16:26 2022] DELETE /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf/os-volume_attachments/38f7dd8f-43f4-4a40-a488-a5d0661b891b => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:16:27.093813 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-06925e96-d6b2-4929-ab6e-1d8c0c00d66a tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:27.102207 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-06925e96-d6b2-4929-ab6e-1d8c0c00d66a tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88" status: 200 len: 1318 microversion: 2.1 time: 0.182493 Oct 24 13:16:27.103016 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 260/532] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:26 2022] GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:27.374470 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-891b1c7f-8636-40c7-89fd-9333a2ef778e tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:27.375203 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-891b1c7f-8636-40c7-89fd-9333a2ef778e tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:27.381380 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-891b1c7f-8636-40c7-89fd-9333a2ef778e tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:27.381864 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-891b1c7f-8636-40c7-89fd-9333a2ef778e tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:27.382297 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-891b1c7f-8636-40c7-89fd-9333a2ef778e tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:27.382993 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-891b1c7f-8636-40c7-89fd-9333a2ef778e tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:27.383511 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-891b1c7f-8636-40c7-89fd-9333a2ef778e tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:27.383933 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-891b1c7f-8636-40c7-89fd-9333a2ef778e tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:27.412916 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-9395fd88-a800-4fdc-a016-fd4b72d5ba13 req-18a4682a-c631-40fa-90aa-3fc1bb074371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "464765b9-dece-4c4b-b84b-9361ad82ac88", "name": "network-vif-plugged", "status": "completed", "tag": "3a4966df-5594-432c-b7ff-77cf8ebddc41"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:27.423514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-9395fd88-a800-4fdc-a016-fd4b72d5ba13 req-18a4682a-c631-40fa-90aa-3fc1bb074371 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:27.424208 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-9395fd88-a800-4fdc-a016-fd4b72d5ba13 req-18a4682a-c631-40fa-90aa-3fc1bb074371 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:27.425112 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-9395fd88-a800-4fdc-a016-fd4b72d5ba13 req-18a4682a-c631-40fa-90aa-3fc1bb074371 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:27.438851 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-9395fd88-a800-4fdc-a016-fd4b72d5ba13 req-18a4682a-c631-40fa-90aa-3fc1bb074371 service nova] Creating event network-vif-plugged:3a4966df-5594-432c-b7ff-77cf8ebddc41 for instance 464765b9-dece-4c4b-b84b-9361ad82ac88 on hv-cinder-86248 Oct 24 13:16:27.444608 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-9395fd88-a800-4fdc-a016-fd4b72d5ba13 req-18a4682a-c631-40fa-90aa-3fc1bb074371 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035328 Oct 24 13:16:27.445368 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 261/533] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:16:27.450704 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-191ce9a1-5130-4faf-aad3-0d6d6634dec9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:27.451562 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-191ce9a1-5130-4faf-aad3-0d6d6634dec9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:27.457810 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-191ce9a1-5130-4faf-aad3-0d6d6634dec9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:27.458512 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-191ce9a1-5130-4faf-aad3-0d6d6634dec9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:27.458948 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-191ce9a1-5130-4faf-aad3-0d6d6634dec9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:27.459684 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-191ce9a1-5130-4faf-aad3-0d6d6634dec9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:27.460139 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-191ce9a1-5130-4faf-aad3-0d6d6634dec9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:27.460759 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-191ce9a1-5130-4faf-aad3-0d6d6634dec9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:27.535583 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-191ce9a1-5130-4faf-aad3-0d6d6634dec9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:27.546156 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-191ce9a1-5130-4faf-aad3-0d6d6634dec9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5" status: 200 len: 1292 microversion: 2.1 time: 0.098878 Oct 24 13:16:27.566720 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 262/534] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:27 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 => generated 1292 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:27.566836 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-891b1c7f-8636-40c7-89fd-9333a2ef778e tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:27.570761 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-891b1c7f-8636-40c7-89fd-9333a2ef778e tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1592 microversion: 2.1 time: 0.200509 Oct 24 13:16:27.575662 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 273/535] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:27 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1592 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:27.575818 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-6d2f10e4-12ff-4bde-9ead-02aed3b10825 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:27.575818 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-6d2f10e4-12ff-4bde-9ead-02aed3b10825 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:27.579517 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6d2f10e4-12ff-4bde-9ead-02aed3b10825 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:27.580245 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6d2f10e4-12ff-4bde-9ead-02aed3b10825 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:27.580770 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6d2f10e4-12ff-4bde-9ead-02aed3b10825 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:27.581559 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6d2f10e4-12ff-4bde-9ead-02aed3b10825 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:27.582108 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6d2f10e4-12ff-4bde-9ead-02aed3b10825 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:27.582643 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6d2f10e4-12ff-4bde-9ead-02aed3b10825 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:27.767758 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-6d2f10e4-12ff-4bde-9ead-02aed3b10825 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:27.777024 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-6d2f10e4-12ff-4bde-9ead-02aed3b10825 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1736 microversion: 2.1 time: 0.208805 Oct 24 13:16:27.777647 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 263/536] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:27 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:28.126023 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a69f6a50-6f44-4e0a-99f8-3a79cd38b7ac tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:28.126637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a69f6a50-6f44-4e0a-99f8-3a79cd38b7ac tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 464765b9-dece-4c4b-b84b-9361ad82ac88] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:28.133826 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a69f6a50-6f44-4e0a-99f8-3a79cd38b7ac tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:28.134314 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a69f6a50-6f44-4e0a-99f8-3a79cd38b7ac tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:28.134747 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a69f6a50-6f44-4e0a-99f8-3a79cd38b7ac tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:28.135713 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a69f6a50-6f44-4e0a-99f8-3a79cd38b7ac tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:28.136167 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a69f6a50-6f44-4e0a-99f8-3a79cd38b7ac tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:28.136590 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a69f6a50-6f44-4e0a-99f8-3a79cd38b7ac tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:28.391988 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a69f6a50-6f44-4e0a-99f8-3a79cd38b7ac tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:28.404728 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a69f6a50-6f44-4e0a-99f8-3a79cd38b7ac tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88" status: 200 len: 1318 microversion: 2.1 time: 0.282406 Oct 24 13:16:28.405636 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 274/537] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:28 2022] GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88 => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:28.573861 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-311ff5d4-7c1c-43f4-a9ff-7e41d41e63ba tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:28.574614 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-311ff5d4-7c1c-43f4-a9ff-7e41d41e63ba tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:28.581081 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-311ff5d4-7c1c-43f4-a9ff-7e41d41e63ba tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:28.581636 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-311ff5d4-7c1c-43f4-a9ff-7e41d41e63ba tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:28.582136 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-311ff5d4-7c1c-43f4-a9ff-7e41d41e63ba tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:28.582892 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-311ff5d4-7c1c-43f4-a9ff-7e41d41e63ba tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:28.583461 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-311ff5d4-7c1c-43f4-a9ff-7e41d41e63ba tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:28.584021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-311ff5d4-7c1c-43f4-a9ff-7e41d41e63ba tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:28.651167 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-311ff5d4-7c1c-43f4-a9ff-7e41d41e63ba tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:28.658739 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-311ff5d4-7c1c-43f4-a9ff-7e41d41e63ba tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5" status: 200 len: 1298 microversion: 2.1 time: 0.088814 Oct 24 13:16:28.659326 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 264/538] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:28 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:28.803255 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-91a9d487-458c-42c2-85da-4f6d71bf8493 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:28.803870 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-91a9d487-458c-42c2-85da-4f6d71bf8493 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:28.810370 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-91a9d487-458c-42c2-85da-4f6d71bf8493 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:28.811117 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-91a9d487-458c-42c2-85da-4f6d71bf8493 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:28.811960 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-91a9d487-458c-42c2-85da-4f6d71bf8493 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:28.812668 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-91a9d487-458c-42c2-85da-4f6d71bf8493 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:28.813289 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-91a9d487-458c-42c2-85da-4f6d71bf8493 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:28.813880 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-91a9d487-458c-42c2-85da-4f6d71bf8493 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:29.301336 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9f11f56c-5d40-4a90-81b6-b511c687e717 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:29.322528 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9f11f56c-5d40-4a90-81b6-b511c687e717 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:29.323436 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9f11f56c-5d40-4a90-81b6-b511c687e717 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:29.324108 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9f11f56c-5d40-4a90-81b6-b511c687e717 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:29.339399 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-91a9d487-458c-42c2-85da-4f6d71bf8493 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:29.351967 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-91a9d487-458c-42c2-85da-4f6d71bf8493 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1736 microversion: 2.1 time: 0.553327 Oct 24 13:16:29.353385 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 275/539] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:28 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1736 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:29.357451 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9f11f56c-5d40-4a90-81b6-b511c687e717 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Going to try to stop instance {{(pid=118915) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 24 13:16:29.410679 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-9f11f56c-5d40-4a90-81b6-b511c687e717 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "POST /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf/action" status: 202 len: 0 microversion: 2.1 time: 0.113769 Oct 24 13:16:29.411304 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 265/540] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 24 13:16:29 2022] POST /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 13:16:29.420617 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-46c22d4b-5edc-4dfc-a25c-78abd25b193d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:29.421464 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-46c22d4b-5edc-4dfc-a25c-78abd25b193d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:29.430606 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-67898332-0671-4745-b915-c2c8aff3695b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:29.431024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-46c22d4b-5edc-4dfc-a25c-78abd25b193d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:29.431361 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-67898332-0671-4745-b915-c2c8aff3695b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 464765b9-dece-4c4b-b84b-9361ad82ac88] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:29.431908 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-46c22d4b-5edc-4dfc-a25c-78abd25b193d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:29.432501 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-46c22d4b-5edc-4dfc-a25c-78abd25b193d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:29.433359 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-46c22d4b-5edc-4dfc-a25c-78abd25b193d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:29.433978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-46c22d4b-5edc-4dfc-a25c-78abd25b193d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:29.434576 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-46c22d4b-5edc-4dfc-a25c-78abd25b193d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:29.438531 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-67898332-0671-4745-b915-c2c8aff3695b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:29.439278 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-67898332-0671-4745-b915-c2c8aff3695b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:29.439871 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-67898332-0671-4745-b915-c2c8aff3695b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:29.440755 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-67898332-0671-4745-b915-c2c8aff3695b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:29.441369 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-67898332-0671-4745-b915-c2c8aff3695b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:29.442124 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-67898332-0671-4745-b915-c2c8aff3695b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:29.448169 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:29.688100 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-67898332-0671-4745-b915-c2c8aff3695b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:29.693122 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-46c22d4b-5edc-4dfc-a25c-78abd25b193d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:29.698520 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-67898332-0671-4745-b915-c2c8aff3695b tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88" status: 200 len: 1318 microversion: 2.1 time: 0.273510 Oct 24 13:16:29.703400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-46c22d4b-5edc-4dfc-a25c-78abd25b193d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1677 microversion: 2.1 time: 0.286628 Oct 24 13:16:29.704724 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 276/541] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:29 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1677 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:29.712212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-2cef1ced-2a30-435c-a33c-7e2351fe4985 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:29.714030 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-2cef1ced-2a30-435c-a33c-7e2351fe4985 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:29.716618 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 266/542] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:29 2022] GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:29.722718 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2cef1ced-2a30-435c-a33c-7e2351fe4985 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:29.724281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2cef1ced-2a30-435c-a33c-7e2351fe4985 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:29.724888 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2cef1ced-2a30-435c-a33c-7e2351fe4985 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:29.725802 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2cef1ced-2a30-435c-a33c-7e2351fe4985 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:29.726495 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2cef1ced-2a30-435c-a33c-7e2351fe4985 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:29.728691 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2cef1ced-2a30-435c-a33c-7e2351fe4985 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:29.956419 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-2cef1ced-2a30-435c-a33c-7e2351fe4985 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:29.971697 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-2cef1ced-2a30-435c-a33c-7e2351fe4985 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5" status: 200 len: 1366 microversion: 2.1 time: 0.264146 Oct 24 13:16:29.973491 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 277/543] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:29 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:30.022752 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-9d08e865-b278-4250-b2a0-28a75bc63ded req-c4cfe679-98f8-482d-81ae-6c55f976feff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5633650-dcf9-49be-b565-3e8fb5a765f4", "tag": "018f2d3e-909b-488a-af88-b11609f2409d"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:30.045161 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-9d08e865-b278-4250-b2a0-28a75bc63ded req-c4cfe679-98f8-482d-81ae-6c55f976feff service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:30.045657 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-9d08e865-b278-4250-b2a0-28a75bc63ded req-c4cfe679-98f8-482d-81ae-6c55f976feff service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:30.048351 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-9d08e865-b278-4250-b2a0-28a75bc63ded req-c4cfe679-98f8-482d-81ae-6c55f976feff service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:30.074001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-9d08e865-b278-4250-b2a0-28a75bc63ded req-c4cfe679-98f8-482d-81ae-6c55f976feff service nova] Creating event network-changed:018f2d3e-909b-488a-af88-b11609f2409d for instance e5633650-dcf9-49be-b565-3e8fb5a765f4 on hv-cinder-86248 Oct 24 13:16:30.084633 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-9d08e865-b278-4250-b2a0-28a75bc63ded req-c4cfe679-98f8-482d-81ae-6c55f976feff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067422 Oct 24 13:16:30.086154 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 267/544] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:16:30.379021 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a30e781b-537d-4841-8817-f04b20f96c3b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:30.382626 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a30e781b-537d-4841-8817-f04b20f96c3b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:30.392488 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a30e781b-537d-4841-8817-f04b20f96c3b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:30.393483 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a30e781b-537d-4841-8817-f04b20f96c3b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:30.394149 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a30e781b-537d-4841-8817-f04b20f96c3b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:30.395147 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a30e781b-537d-4841-8817-f04b20f96c3b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:30.397612 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a30e781b-537d-4841-8817-f04b20f96c3b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:30.398295 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a30e781b-537d-4841-8817-f04b20f96c3b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:30.640832 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a30e781b-537d-4841-8817-f04b20f96c3b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:30.654783 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a30e781b-537d-4841-8817-f04b20f96c3b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1736 microversion: 2.1 time: 0.280771 Oct 24 13:16:30.659375 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 278/545] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:30 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1736 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:30.704570 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-8967b020-1f73-46c9-b16b-89f61275b0a3 req-2b62cb40-73de-4459-878a-24098a7acfc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1f32388-2b31-4b4f-be1e-1a6b04ce35a5", "tag": "f22388f7-ae14-4f13-95c4-629680f0fec8"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:30.715000 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-8967b020-1f73-46c9-b16b-89f61275b0a3 req-2b62cb40-73de-4459-878a-24098a7acfc5 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:30.715000 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-8967b020-1f73-46c9-b16b-89f61275b0a3 req-2b62cb40-73de-4459-878a-24098a7acfc5 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:30.715000 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-8967b020-1f73-46c9-b16b-89f61275b0a3 req-2b62cb40-73de-4459-878a-24098a7acfc5 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:30.721877 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-75046670-0cfb-48b7-8a5c-47b9a9510cc8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:30.722494 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-75046670-0cfb-48b7-8a5c-47b9a9510cc8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 464765b9-dece-4c4b-b84b-9361ad82ac88] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:30.730710 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-75046670-0cfb-48b7-8a5c-47b9a9510cc8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:30.732414 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-75046670-0cfb-48b7-8a5c-47b9a9510cc8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:30.734358 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-75046670-0cfb-48b7-8a5c-47b9a9510cc8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:30.734358 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-75046670-0cfb-48b7-8a5c-47b9a9510cc8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:30.734358 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-75046670-0cfb-48b7-8a5c-47b9a9510cc8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:30.739418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-75046670-0cfb-48b7-8a5c-47b9a9510cc8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:30.750357 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-8967b020-1f73-46c9-b16b-89f61275b0a3 req-2b62cb40-73de-4459-878a-24098a7acfc5 service nova] Creating event network-changed:f22388f7-ae14-4f13-95c4-629680f0fec8 for instance d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 on hv-cinder-86248 Oct 24 13:16:30.764850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-8967b020-1f73-46c9-b16b-89f61275b0a3 req-2b62cb40-73de-4459-878a-24098a7acfc5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069291 Oct 24 13:16:30.765780 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 268/546] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:16:30.771100 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-655dcf91-c2a6-47fa-aee1-b807115a2ba3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:30.775924 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-655dcf91-c2a6-47fa-aee1-b807115a2ba3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:30.796285 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-655dcf91-c2a6-47fa-aee1-b807115a2ba3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:30.797077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-655dcf91-c2a6-47fa-aee1-b807115a2ba3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:30.797808 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-655dcf91-c2a6-47fa-aee1-b807115a2ba3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:30.798795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-655dcf91-c2a6-47fa-aee1-b807115a2ba3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:30.799437 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-655dcf91-c2a6-47fa-aee1-b807115a2ba3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:30.800016 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-655dcf91-c2a6-47fa-aee1-b807115a2ba3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:31.039115 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-75046670-0cfb-48b7-8a5c-47b9a9510cc8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:31.056732 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-75046670-0cfb-48b7-8a5c-47b9a9510cc8 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88" status: 200 len: 1508 microversion: 2.1 time: 0.338832 Oct 24 13:16:31.060496 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 279/547] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:30 2022] GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88 => generated 1508 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:31.065982 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-9971131e-932f-4c90-9a08-5da88927e26b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:31.073123 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-9971131e-932f-4c90-9a08-5da88927e26b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:31.085996 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9971131e-932f-4c90-9a08-5da88927e26b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:31.096225 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9971131e-932f-4c90-9a08-5da88927e26b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:31.096880 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9971131e-932f-4c90-9a08-5da88927e26b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:31.097652 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9971131e-932f-4c90-9a08-5da88927e26b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:31.100883 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9971131e-932f-4c90-9a08-5da88927e26b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:31.101325 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9971131e-932f-4c90-9a08-5da88927e26b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:31.235844 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-655dcf91-c2a6-47fa-aee1-b807115a2ba3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:31.245135 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-655dcf91-c2a6-47fa-aee1-b807115a2ba3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1677 microversion: 2.1 time: 0.478138 Oct 24 13:16:31.245714 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 269/548] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:30 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1677 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:31.265940 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-1e50b9f9-be82-4640-9a7d-ba6ee7c5b816 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a17c68f-94de-4b1d-861f-d77200259994", "device": "/dev/sdb"}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:31.269133 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-1e50b9f9-be82-4640-9a7d-ba6ee7c5b816 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 464765b9-dece-4c4b-b84b-9361ad82ac88] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:31.273981 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-9971131e-932f-4c90-9a08-5da88927e26b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:31.276049 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1e50b9f9-be82-4640-9a7d-ba6ee7c5b816 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:31.276595 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1e50b9f9-be82-4640-9a7d-ba6ee7c5b816 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:31.277109 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1e50b9f9-be82-4640-9a7d-ba6ee7c5b816 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:31.277807 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1e50b9f9-be82-4640-9a7d-ba6ee7c5b816 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:31.278436 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1e50b9f9-be82-4640-9a7d-ba6ee7c5b816 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:31.279008 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1e50b9f9-be82-4640-9a7d-ba6ee7c5b816 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:31.282663 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-9971131e-932f-4c90-9a08-5da88927e26b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5" status: 200 len: 1366 microversion: 2.1 time: 0.220710 Oct 24 13:16:31.283715 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 280/549] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:31 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:31.677933 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-baa30930-ac73-4393-9242-b5e100535119 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:31.682124 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-baa30930-ac73-4393-9242-b5e100535119 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:31.697323 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-baa30930-ac73-4393-9242-b5e100535119 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:31.697839 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-baa30930-ac73-4393-9242-b5e100535119 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:31.698288 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-baa30930-ac73-4393-9242-b5e100535119 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:31.699003 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-baa30930-ac73-4393-9242-b5e100535119 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:31.699487 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-baa30930-ac73-4393-9242-b5e100535119 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:31.699911 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-baa30930-ac73-4393-9242-b5e100535119 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:31.725216 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-1e50b9f9-be82-4640-9a7d-ba6ee7c5b816 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "POST /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.467872 Oct 24 13:16:31.731875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 270/550] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 24 13:16:31 2022] POST /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88/os-volume_attachments => generated 194 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:16:31.931558 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-baa30930-ac73-4393-9242-b5e100535119 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:31.939982 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-baa30930-ac73-4393-9242-b5e100535119 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1736 microversion: 2.1 time: 0.266038 Oct 24 13:16:31.940694 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 281/551] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:31 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1736 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:32.056940 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-f1642c8c-0a72-497a-b5a9-8cbcf471fbec tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1521375948"}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:32.057581 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-f1642c8c-0a72-497a-b5a9-8cbcf471fbec tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:32.064270 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f1642c8c-0a72-497a-b5a9-8cbcf471fbec tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:32.064692 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f1642c8c-0a72-497a-b5a9-8cbcf471fbec tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:32.065122 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f1642c8c-0a72-497a-b5a9-8cbcf471fbec tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:32.065822 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f1642c8c-0a72-497a-b5a9-8cbcf471fbec tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:32.066262 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f1642c8c-0a72-497a-b5a9-8cbcf471fbec tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:32.066680 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f1642c8c-0a72-497a-b5a9-8cbcf471fbec tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:32.204678 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.network.security_group_api [None req-f1642c8c-0a72-497a-b5a9-8cbcf471fbec tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Adding security group 31fd1301-f176-4b08-b18d-2698cccfa8e3 to port 018f2d3e-909b-488a-af88-b11609f2409d Oct 24 13:16:32.273557 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-fe98a726-51e6-4ae9-ab1f-b5c1fc99d17f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:32.275107 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-fe98a726-51e6-4ae9-ab1f-b5c1fc99d17f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:32.281936 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fe98a726-51e6-4ae9-ab1f-b5c1fc99d17f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:32.282549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fe98a726-51e6-4ae9-ab1f-b5c1fc99d17f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:32.283140 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fe98a726-51e6-4ae9-ab1f-b5c1fc99d17f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:32.284029 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fe98a726-51e6-4ae9-ab1f-b5c1fc99d17f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:32.284562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fe98a726-51e6-4ae9-ab1f-b5c1fc99d17f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:32.285100 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fe98a726-51e6-4ae9-ab1f-b5c1fc99d17f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:32.446237 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-fe98a726-51e6-4ae9-ab1f-b5c1fc99d17f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:32.454337 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-fe98a726-51e6-4ae9-ab1f-b5c1fc99d17f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1677 microversion: 2.1 time: 0.185105 Oct 24 13:16:32.455014 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 282/552] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:32 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:32.460293 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-e9353f50-f460-4d3d-a212-5eba98525103 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:32.460994 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-e9353f50-f460-4d3d-a212-5eba98525103 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:32.467861 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e9353f50-f460-4d3d-a212-5eba98525103 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:32.468426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e9353f50-f460-4d3d-a212-5eba98525103 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:32.468935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e9353f50-f460-4d3d-a212-5eba98525103 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:32.469758 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e9353f50-f460-4d3d-a212-5eba98525103 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:32.470282 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e9353f50-f460-4d3d-a212-5eba98525103 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:32.470781 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e9353f50-f460-4d3d-a212-5eba98525103 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:32.600658 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-e9353f50-f460-4d3d-a212-5eba98525103 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:32.609143 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-e9353f50-f460-4d3d-a212-5eba98525103 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5" status: 200 len: 1366 microversion: 2.1 time: 0.153002 Oct 24 13:16:32.609714 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 283/553] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:32 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:32.769372 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-f1642c8c-0a72-497a-b5a9-8cbcf471fbec tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "POST /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4/action" status: 202 len: 0 microversion: 2.1 time: 0.720058 Oct 24 13:16:32.769372 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 271/554] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 24 13:16:32 2022] POST /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4/action => generated 0 bytes in 722 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:16:32.778616 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-2eabd933-45bd-4477-8384-b51bfc14f625 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:32.779861 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-2eabd933-45bd-4477-8384-b51bfc14f625 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:32.782463 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:32.789231 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2eabd933-45bd-4477-8384-b51bfc14f625 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:32.790557 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2eabd933-45bd-4477-8384-b51bfc14f625 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:32.791018 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2eabd933-45bd-4477-8384-b51bfc14f625 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:32.792370 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2eabd933-45bd-4477-8384-b51bfc14f625 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:32.792845 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2eabd933-45bd-4477-8384-b51bfc14f625 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:32.793318 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2eabd933-45bd-4477-8384-b51bfc14f625 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:32.804530 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-d9b6685f-61f6-4f5a-9874-796311ee7351 req-f286e2b2-17f0-4f49-9f9a-b2d1ab59c518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5633650-dcf9-49be-b565-3e8fb5a765f4", "tag": "018f2d3e-909b-488a-af88-b11609f2409d"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:32.818991 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-d9b6685f-61f6-4f5a-9874-796311ee7351 req-f286e2b2-17f0-4f49-9f9a-b2d1ab59c518 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:32.821177 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-d9b6685f-61f6-4f5a-9874-796311ee7351 req-f286e2b2-17f0-4f49-9f9a-b2d1ab59c518 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:32.822160 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-d9b6685f-61f6-4f5a-9874-796311ee7351 req-f286e2b2-17f0-4f49-9f9a-b2d1ab59c518 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:32.857464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-d9b6685f-61f6-4f5a-9874-796311ee7351 req-f286e2b2-17f0-4f49-9f9a-b2d1ab59c518 service nova] Creating event network-changed:018f2d3e-909b-488a-af88-b11609f2409d for instance e5633650-dcf9-49be-b565-3e8fb5a765f4 on hv-cinder-86248 Oct 24 13:16:32.872246 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-d9b6685f-61f6-4f5a-9874-796311ee7351 req-f286e2b2-17f0-4f49-9f9a-b2d1ab59c518 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074632 Oct 24 13:16:32.873586 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 272/555] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:16:32.886623 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-4c28d0f3-3125-4bfd-968b-41f6a0547ea5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:32.887793 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-4c28d0f3-3125-4bfd-968b-41f6a0547ea5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:32.894687 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4c28d0f3-3125-4bfd-968b-41f6a0547ea5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:32.895494 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4c28d0f3-3125-4bfd-968b-41f6a0547ea5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:32.896102 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4c28d0f3-3125-4bfd-968b-41f6a0547ea5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:32.898784 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4c28d0f3-3125-4bfd-968b-41f6a0547ea5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:32.903506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4c28d0f3-3125-4bfd-968b-41f6a0547ea5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:32.904041 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4c28d0f3-3125-4bfd-968b-41f6a0547ea5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:32.947547 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-4c28d0f3-3125-4bfd-968b-41f6a0547ea5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments/a5bd14cc-b177-4b7f-b96e-12a6f9ad5374" status: 200 len: 194 microversion: 2.20 time: 0.072509 Oct 24 13:16:32.948452 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 273/556] 10.222.0.42 () {60 vars in 1454 bytes} [Mon Oct 24 13:16:32 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments/a5bd14cc-b177-4b7f-b96e-12a6f9ad5374 => generated 194 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:16:32.968879 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-bf5c332c-a34b-447f-9c90-15730164b074 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:32.970706 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-bf5c332c-a34b-447f-9c90-15730164b074 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:32.979384 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-2eabd933-45bd-4477-8384-b51bfc14f625 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:32.981738 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bf5c332c-a34b-447f-9c90-15730164b074 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:32.982240 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bf5c332c-a34b-447f-9c90-15730164b074 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:32.982673 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bf5c332c-a34b-447f-9c90-15730164b074 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:32.983400 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bf5c332c-a34b-447f-9c90-15730164b074 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:32.983852 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bf5c332c-a34b-447f-9c90-15730164b074 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:32.984270 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bf5c332c-a34b-447f-9c90-15730164b074 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:33.003708 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-2eabd933-45bd-4477-8384-b51bfc14f625 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1757 microversion: 2.1 time: 0.228668 Oct 24 13:16:33.005047 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 284/557] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:32 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1757 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:33.072719 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-f7e79881-f886-4101-86bc-fe09c1265f8f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:33.073676 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-f7e79881-f886-4101-86bc-fe09c1265f8f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:33.081531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f7e79881-f886-4101-86bc-fe09c1265f8f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:33.082032 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f7e79881-f886-4101-86bc-fe09c1265f8f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:33.082471 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f7e79881-f886-4101-86bc-fe09c1265f8f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:33.083213 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f7e79881-f886-4101-86bc-fe09c1265f8f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:33.083679 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f7e79881-f886-4101-86bc-fe09c1265f8f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:33.084104 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f7e79881-f886-4101-86bc-fe09c1265f8f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:33.179503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.objects.instance [None req-f7e79881-f886-4101-86bc-fe09c1265f8f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lazy-loading 'services' on Instance uuid 27b5963f-5199-4822-a8c3-20a8ab09224f {{(pid=118914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:16:33.204410 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-bf5c332c-a34b-447f-9c90-15730164b074 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:33.213328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-bf5c332c-a34b-447f-9c90-15730164b074 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1736 microversion: 2.1 time: 0.250904 Oct 24 13:16:33.227339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 274/558] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:32 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1736 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:33.255544 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-f7e79881-f886-4101-86bc-fe09c1265f8f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "DELETE /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments/a5bd14cc-b177-4b7f-b96e-12a6f9ad5374" status: 202 len: 0 microversion: 2.20 time: 0.187360 Oct 24 13:16:33.256260 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 285/559] 10.222.0.42 () {60 vars in 1457 bytes} [Mon Oct 24 13:16:33 2022] DELETE /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments/a5bd14cc-b177-4b7f-b96e-12a6f9ad5374 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 24 13:16:33.265599 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-6ac3e3c6-9ec5-41da-944d-758015ac4263 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:33.268001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-6ac3e3c6-9ec5-41da-944d-758015ac4263 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:33.273836 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6ac3e3c6-9ec5-41da-944d-758015ac4263 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:33.274303 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6ac3e3c6-9ec5-41da-944d-758015ac4263 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:33.274927 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6ac3e3c6-9ec5-41da-944d-758015ac4263 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:33.275641 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6ac3e3c6-9ec5-41da-944d-758015ac4263 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:33.276093 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6ac3e3c6-9ec5-41da-944d-758015ac4263 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:33.276513 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6ac3e3c6-9ec5-41da-944d-758015ac4263 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:33.308879 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-6ac3e3c6-9ec5-41da-944d-758015ac4263 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047150 Oct 24 13:16:33.313846 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 275/560] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Oct 24 13:16:33 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:16:33.479064 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-cffdfa0c-4aea-47b3-9479-342cc5e5b24a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:33.479805 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-cffdfa0c-4aea-47b3-9479-342cc5e5b24a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:33.485965 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cffdfa0c-4aea-47b3-9479-342cc5e5b24a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:33.486462 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cffdfa0c-4aea-47b3-9479-342cc5e5b24a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:33.486901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cffdfa0c-4aea-47b3-9479-342cc5e5b24a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:33.487618 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cffdfa0c-4aea-47b3-9479-342cc5e5b24a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:33.488076 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cffdfa0c-4aea-47b3-9479-342cc5e5b24a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:33.488502 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cffdfa0c-4aea-47b3-9479-342cc5e5b24a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:33.616230 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-cffdfa0c-4aea-47b3-9479-342cc5e5b24a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:33.625052 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-cffdfa0c-4aea-47b3-9479-342cc5e5b24a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1677 microversion: 2.1 time: 0.150883 Oct 24 13:16:33.625548 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 286/561] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:33 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:33.633220 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-df9a61c3-1e49-4d6a-81c5-3ec011b015bf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:33.634459 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-df9a61c3-1e49-4d6a-81c5-3ec011b015bf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:33.640612 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-df9a61c3-1e49-4d6a-81c5-3ec011b015bf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:33.641164 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-df9a61c3-1e49-4d6a-81c5-3ec011b015bf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:33.641671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-df9a61c3-1e49-4d6a-81c5-3ec011b015bf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:33.642480 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-df9a61c3-1e49-4d6a-81c5-3ec011b015bf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:33.642936 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-df9a61c3-1e49-4d6a-81c5-3ec011b015bf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:33.643383 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-df9a61c3-1e49-4d6a-81c5-3ec011b015bf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:33.772473 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-df9a61c3-1e49-4d6a-81c5-3ec011b015bf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:33.780493 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-df9a61c3-1e49-4d6a-81c5-3ec011b015bf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5" status: 200 len: 1366 microversion: 2.1 time: 0.151296 Oct 24 13:16:33.781052 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 276/562] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:33 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:34.237270 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-3ffc9bd5-2a37-48c4-bf32-1b2947f056f6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:34.237822 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-3ffc9bd5-2a37-48c4-bf32-1b2947f056f6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:34.244225 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3ffc9bd5-2a37-48c4-bf32-1b2947f056f6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:34.244709 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3ffc9bd5-2a37-48c4-bf32-1b2947f056f6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:34.245144 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3ffc9bd5-2a37-48c4-bf32-1b2947f056f6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:34.245830 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3ffc9bd5-2a37-48c4-bf32-1b2947f056f6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:34.246286 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3ffc9bd5-2a37-48c4-bf32-1b2947f056f6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:34.246713 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3ffc9bd5-2a37-48c4-bf32-1b2947f056f6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:34.265555 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:34.323559 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-571703d4-d3d1-458c-8fc5-ce47527da15f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:34.325773 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-571703d4-d3d1-458c-8fc5-ce47527da15f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:34.333168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-571703d4-d3d1-458c-8fc5-ce47527da15f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:34.333645 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-571703d4-d3d1-458c-8fc5-ce47527da15f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:34.334074 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-571703d4-d3d1-458c-8fc5-ce47527da15f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:34.334763 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-571703d4-d3d1-458c-8fc5-ce47527da15f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:34.335241 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-571703d4-d3d1-458c-8fc5-ce47527da15f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:34.335824 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-571703d4-d3d1-458c-8fc5-ce47527da15f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:34.367152 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-571703d4-d3d1-458c-8fc5-ce47527da15f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048650 Oct 24 13:16:34.367798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 277/563] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Oct 24 13:16:34 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 13:16:34.385287 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-3ffc9bd5-2a37-48c4-bf32-1b2947f056f6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:34.393933 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-3ffc9bd5-2a37-48c4-bf32-1b2947f056f6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1736 microversion: 2.1 time: 0.160656 Oct 24 13:16:34.394497 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 287/564] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:34 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:34.649386 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-2d718d1a-ef55-49e2-a73d-cdf9c60873c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:34.650050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-2d718d1a-ef55-49e2-a73d-cdf9c60873c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:34.656392 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2d718d1a-ef55-49e2-a73d-cdf9c60873c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:34.656877 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2d718d1a-ef55-49e2-a73d-cdf9c60873c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:34.657308 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2d718d1a-ef55-49e2-a73d-cdf9c60873c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:34.658204 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2d718d1a-ef55-49e2-a73d-cdf9c60873c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:34.658717 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2d718d1a-ef55-49e2-a73d-cdf9c60873c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:34.659317 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2d718d1a-ef55-49e2-a73d-cdf9c60873c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:34.796511 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-2d718d1a-ef55-49e2-a73d-cdf9c60873c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:34.804574 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-2d718d1a-ef55-49e2-a73d-cdf9c60873c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1677 microversion: 2.1 time: 0.159086 Oct 24 13:16:34.805818 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 278/565] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:34 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:34.806589 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c820f4c3-1a2e-4f29-8296-4b5fab8fb7e8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:34.807248 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-c820f4c3-1a2e-4f29-8296-4b5fab8fb7e8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:34.813121 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c820f4c3-1a2e-4f29-8296-4b5fab8fb7e8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:34.813602 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c820f4c3-1a2e-4f29-8296-4b5fab8fb7e8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:34.814027 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c820f4c3-1a2e-4f29-8296-4b5fab8fb7e8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:34.814705 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c820f4c3-1a2e-4f29-8296-4b5fab8fb7e8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:34.815175 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c820f4c3-1a2e-4f29-8296-4b5fab8fb7e8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:34.815596 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c820f4c3-1a2e-4f29-8296-4b5fab8fb7e8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:34.945293 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-c820f4c3-1a2e-4f29-8296-4b5fab8fb7e8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:34.953515 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-c820f4c3-1a2e-4f29-8296-4b5fab8fb7e8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5" status: 200 len: 1366 microversion: 2.1 time: 0.151996 Oct 24 13:16:34.954096 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 288/566] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:34 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:35.379223 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-fe092897-7aad-402a-b6a1-3c8315f21f82 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:35.381437 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-fe092897-7aad-402a-b6a1-3c8315f21f82 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:35.389534 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fe092897-7aad-402a-b6a1-3c8315f21f82 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:35.390022 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fe092897-7aad-402a-b6a1-3c8315f21f82 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:35.390458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fe092897-7aad-402a-b6a1-3c8315f21f82 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:35.391194 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fe092897-7aad-402a-b6a1-3c8315f21f82 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:35.391652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fe092897-7aad-402a-b6a1-3c8315f21f82 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:35.392075 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fe092897-7aad-402a-b6a1-3c8315f21f82 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:35.417802 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-fa07ee16-6c84-4928-80c0-298f461edabd tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:35.418964 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-fa07ee16-6c84-4928-80c0-298f461edabd tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:35.423957 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-fe092897-7aad-402a-b6a1-3c8315f21f82 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048640 Oct 24 13:16:35.424919 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 279/567] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Oct 24 13:16:35 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:16:35.429791 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa07ee16-6c84-4928-80c0-298f461edabd tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:35.430949 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa07ee16-6c84-4928-80c0-298f461edabd tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:35.431419 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa07ee16-6c84-4928-80c0-298f461edabd tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:35.432133 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa07ee16-6c84-4928-80c0-298f461edabd tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:35.432590 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa07ee16-6c84-4928-80c0-298f461edabd tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:35.433266 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fa07ee16-6c84-4928-80c0-298f461edabd tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:35.577867 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-fa07ee16-6c84-4928-80c0-298f461edabd tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:35.586106 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-fa07ee16-6c84-4928-80c0-298f461edabd tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1736 microversion: 2.1 time: 0.172231 Oct 24 13:16:35.586863 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 289/568] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:35 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:35.829140 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-91bc504a-2826-462c-8dbb-f019ee867bd3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:35.829732 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-91bc504a-2826-462c-8dbb-f019ee867bd3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:35.835564 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-91bc504a-2826-462c-8dbb-f019ee867bd3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:35.836047 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-91bc504a-2826-462c-8dbb-f019ee867bd3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:35.836477 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-91bc504a-2826-462c-8dbb-f019ee867bd3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:35.837166 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-91bc504a-2826-462c-8dbb-f019ee867bd3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:35.837613 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-91bc504a-2826-462c-8dbb-f019ee867bd3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:35.838031 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-91bc504a-2826-462c-8dbb-f019ee867bd3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:35.968957 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-91bc504a-2826-462c-8dbb-f019ee867bd3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:35.977398 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-91bc504a-2826-462c-8dbb-f019ee867bd3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1677 microversion: 2.1 time: 0.151556 Oct 24 13:16:35.977688 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-9087baa9-c707-4ac4-a5de-f36f19c6526a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:35.978102 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 280/569] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:35 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:35.978310 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-9087baa9-c707-4ac4-a5de-f36f19c6526a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:35.984194 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9087baa9-c707-4ac4-a5de-f36f19c6526a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:35.984679 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9087baa9-c707-4ac4-a5de-f36f19c6526a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:35.985119 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9087baa9-c707-4ac4-a5de-f36f19c6526a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:35.985813 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9087baa9-c707-4ac4-a5de-f36f19c6526a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:35.986274 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9087baa9-c707-4ac4-a5de-f36f19c6526a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:35.986698 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9087baa9-c707-4ac4-a5de-f36f19c6526a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:36.118122 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-9087baa9-c707-4ac4-a5de-f36f19c6526a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:36.125713 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-9087baa9-c707-4ac4-a5de-f36f19c6526a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5" status: 200 len: 1366 microversion: 2.1 time: 0.152356 Oct 24 13:16:36.126275 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 290/570] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:35 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:36.436035 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-c273a947-e682-4285-8297-9934703b34b8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:36.440966 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-c273a947-e682-4285-8297-9934703b34b8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:36.442977 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=4 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:36.443702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=6 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:36.450861 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c273a947-e682-4285-8297-9934703b34b8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:36.451364 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c273a947-e682-4285-8297-9934703b34b8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:36.451799 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c273a947-e682-4285-8297-9934703b34b8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:36.452497 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c273a947-e682-4285-8297-9934703b34b8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:36.452949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c273a947-e682-4285-8297-9934703b34b8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:36.453372 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c273a947-e682-4285-8297-9934703b34b8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:36.482924 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-c273a947-e682-4285-8297-9934703b34b8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050891 Oct 24 13:16:36.483508 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 281/571] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Oct 24 13:16:36 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 13:16:36.610063 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-02ece6de-3ea5-4c01-8b9f-6059c5e6e9e5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:36.610680 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-02ece6de-3ea5-4c01-8b9f-6059c5e6e9e5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:36.612731 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=14 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:36.618306 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02ece6de-3ea5-4c01-8b9f-6059c5e6e9e5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:36.618791 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02ece6de-3ea5-4c01-8b9f-6059c5e6e9e5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:36.619283 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02ece6de-3ea5-4c01-8b9f-6059c5e6e9e5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:36.619956 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02ece6de-3ea5-4c01-8b9f-6059c5e6e9e5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:36.620417 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02ece6de-3ea5-4c01-8b9f-6059c5e6e9e5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:36.620843 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02ece6de-3ea5-4c01-8b9f-6059c5e6e9e5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:36.752936 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-02ece6de-3ea5-4c01-8b9f-6059c5e6e9e5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:36.761823 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-02ece6de-3ea5-4c01-8b9f-6059c5e6e9e5 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1716 microversion: 2.1 time: 0.155743 Oct 24 13:16:36.762390 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 291/572] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:36 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:36.872477 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-ae377627-e8e7-4082-884e-dc39f2f08b6a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:36.873000 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-ae377627-e8e7-4082-884e-dc39f2f08b6a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:36.878827 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ae377627-e8e7-4082-884e-dc39f2f08b6a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:36.879353 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ae377627-e8e7-4082-884e-dc39f2f08b6a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:36.879787 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ae377627-e8e7-4082-884e-dc39f2f08b6a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:36.880475 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ae377627-e8e7-4082-884e-dc39f2f08b6a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:36.880932 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ae377627-e8e7-4082-884e-dc39f2f08b6a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:36.881356 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ae377627-e8e7-4082-884e-dc39f2f08b6a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:36.960998 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-ae377627-e8e7-4082-884e-dc39f2f08b6a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] HTTP exception thrown: Cannot 'detach_volume' instance 6bd238e2-4223-465c-8028-c291fe1db874 while it is in vm_state rescued Oct 24 13:16:36.962894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-ae377627-e8e7-4082-884e-dc39f2f08b6a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Request method failure captured: Oct 24 13:16:36.962894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: DELETE /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-volume_attachments/96a50e5f-05ec-43df-b264-7e33f54801bc HTTP/1.1 Oct 24 13:16:36.962894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:16:36.962894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:16:36.962894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:16:36.962894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:16:36.962894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:16:36.962894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:16:36.962894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:16:36.962894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:16:36.962894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo8-MVUZt3eqKP9axHhN9-YGEl3TZduwFjpEinzp6vl_5EPjxspkm0YjnuEeX52n_zMOBC2DHbIvahT4eFkJ4bpeh_VkPLMHqyH0kf3GvMdexv9ZvJHWuw2mGfp1Tv9L3Xia6cV13F533nQVQsLnKzwUhe5Mqd9rFhScRAi468eY_Qw Oct 24 13:16:36.962894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:16:36.962894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:16:36.962894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:16:36.962894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:16:36.962894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:16:36.962894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:16:36.962894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: 85d62dec32104e7b8c595953a479026b Oct 24 13:16:36.962894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2008376724 Oct 24 13:16:36.962894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:16:36.962894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:16:36.964475 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/85d62dec32104e7b8c595953a479026b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/85d62dec32104e7b8c595953a479026b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/85d62dec32104e7b8c595953a479026b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_85d62dec32104e7b8c595953a479026b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:16:36.964475 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2008376724 Oct 24 13:16:36.964475 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: 85d62dec32104e7b8c595953a479026b Oct 24 13:16:36.964475 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2008376724 Oct 24 13:16:36.964475 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-ServerRescueNegativeTestJSON-2008376724-project Oct 24 13:16:36.964475 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:16:36.964475 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:16:36.964475 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: d29ff25b062346f6bcf9910b1fa8db5c Oct 24 13:16:36.964475 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2008376724-project Oct 24 13:16:36.964475 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:16:36.964475 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Cannot 'detach_volume' instance 6bd238e2-4223-465c-8028-c291fe1db874 while it is in vm_state rescued Oct 24 13:16:36.965273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'server_id': '6bd238e2-4223-465c-8028-c291fe1db874', 'id': '96a50e5f-05ec-43df-b264-7e33f54801bc'} Oct 24 13:16:36.965273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:16:36.965273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:16:36.965273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 24 13:16:36.965273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 24 13:16:36.965273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 13:16:36.965273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 13:16:36.965273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 24 13:16:36.965273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 24 13:16:36.965273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6bd238e2-4223-465c-8028-c291fe1db874 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 24 13:16:36.965273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:16:36.965273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:16:36.965273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:16:36.965273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:16:36.965273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:16:36.965273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:16:36.965273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:16:36.965273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:16:36.965273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:16:36.965273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:16:36.966788 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 24 13:16:36.966788 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 24 13:16:36.966788 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 24 13:16:36.966788 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 24 13:16:36.966788 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6bd238e2-4223-465c-8028-c291fe1db874 while it is in vm_state rescued Oct 24 13:16:36.966788 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:16:36.966788 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:16:36.966788 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:16:36.966788 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:16:36.966788 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:16:36.966788 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:16:36.966788 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:16:36.966788 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:16:36.966788 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6bd238e2-4223-465c-8028-c291fe1db874 while it is in vm_state rescued Oct 24 13:16:36.966788 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:16:36.966788 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-ae377627-e8e7-4082-884e-dc39f2f08b6a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Returning 409 to user: Cannot 'detach_volume' instance 6bd238e2-4223-465c-8028-c291fe1db874 while it is in vm_state rescued {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:16:36.967986 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-ae377627-e8e7-4082-884e-dc39f2f08b6a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-volume_attachments/96a50e5f-05ec-43df-b264-7e33f54801bc" status: 409 len: 152 microversion: 2.1 time: 0.095654 Oct 24 13:16:36.967986 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 282/573] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 24 13:16:36 2022] DELETE /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-volume_attachments/96a50e5f-05ec-43df-b264-7e33f54801bc => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 24 13:16:36.973203 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-e74d9c42-be0c-4508-8e36-47023f94eb3c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:36.973743 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-e74d9c42-be0c-4508-8e36-47023f94eb3c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:36.979701 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e74d9c42-be0c-4508-8e36-47023f94eb3c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:36.980176 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e74d9c42-be0c-4508-8e36-47023f94eb3c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:36.980606 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e74d9c42-be0c-4508-8e36-47023f94eb3c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:36.981285 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e74d9c42-be0c-4508-8e36-47023f94eb3c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:36.981734 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e74d9c42-be0c-4508-8e36-47023f94eb3c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:36.982158 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e74d9c42-be0c-4508-8e36-47023f94eb3c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:37.000530 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-90ea5358-f2f4-4bee-929b-be31b12bf693 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:37.001136 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-90ea5358-f2f4-4bee-929b-be31b12bf693 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:37.007616 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-90ea5358-f2f4-4bee-929b-be31b12bf693 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:37.008872 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-90ea5358-f2f4-4bee-929b-be31b12bf693 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:37.009529 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-90ea5358-f2f4-4bee-929b-be31b12bf693 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:37.010212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-90ea5358-f2f4-4bee-929b-be31b12bf693 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:37.010925 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-90ea5358-f2f4-4bee-929b-be31b12bf693 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:37.011372 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-90ea5358-f2f4-4bee-929b-be31b12bf693 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:37.049423 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-e74d9c42-be0c-4508-8e36-47023f94eb3c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "POST /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/action" status: 202 len: 0 microversion: 2.1 time: 0.079622 Oct 24 13:16:37.053104 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 292/574] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 24 13:16:36 2022] POST /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:16:37.059667 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-b7999164-80bf-4988-8fd2-40cc8b349df2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:37.060560 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-b7999164-80bf-4988-8fd2-40cc8b349df2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:37.067408 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b7999164-80bf-4988-8fd2-40cc8b349df2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:37.067907 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b7999164-80bf-4988-8fd2-40cc8b349df2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:37.068349 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b7999164-80bf-4988-8fd2-40cc8b349df2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:37.069061 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b7999164-80bf-4988-8fd2-40cc8b349df2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:37.069526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b7999164-80bf-4988-8fd2-40cc8b349df2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:37.069956 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b7999164-80bf-4988-8fd2-40cc8b349df2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:37.188712 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-90ea5358-f2f4-4bee-929b-be31b12bf693 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:37.191014 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:37.198241 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-90ea5358-f2f4-4bee-929b-be31b12bf693 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1677 microversion: 2.1 time: 0.201272 Oct 24 13:16:37.198963 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 283/575] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:36 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1677 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:37.203748 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-333e3aea-865b-42f6-8e0c-eb1544589b27 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:37.204348 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-333e3aea-865b-42f6-8e0c-eb1544589b27 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:37.210260 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-333e3aea-865b-42f6-8e0c-eb1544589b27 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:37.210910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-333e3aea-865b-42f6-8e0c-eb1544589b27 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:37.211542 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-333e3aea-865b-42f6-8e0c-eb1544589b27 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:37.212404 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-333e3aea-865b-42f6-8e0c-eb1544589b27 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:37.213009 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-333e3aea-865b-42f6-8e0c-eb1544589b27 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:37.213580 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-333e3aea-865b-42f6-8e0c-eb1544589b27 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:37.241363 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-b7999164-80bf-4988-8fd2-40cc8b349df2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:37.250270 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-b7999164-80bf-4988-8fd2-40cc8b349df2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1724 microversion: 2.1 time: 0.195469 Oct 24 13:16:37.250972 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 293/576] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:37 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:37.409959 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-333e3aea-865b-42f6-8e0c-eb1544589b27 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:37.418908 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-333e3aea-865b-42f6-8e0c-eb1544589b27 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5" status: 200 len: 1366 microversion: 2.1 time: 0.219075 Oct 24 13:16:37.420056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 284/577] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:37 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:37.442075 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-98929100-a473-4f26-865e-d842c5413c86 req-a4f767ea-e2b8-4f19-9867-24bd6bc8fe3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f32388-2b31-4b4f-be1e-1a6b04ce35a5", "name": "network-vif-plugged", "status": "completed", "tag": "f22388f7-ae14-4f13-95c4-629680f0fec8"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:37.455314 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-98929100-a473-4f26-865e-d842c5413c86 req-a4f767ea-e2b8-4f19-9867-24bd6bc8fe3d service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:37.455808 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-98929100-a473-4f26-865e-d842c5413c86 req-a4f767ea-e2b8-4f19-9867-24bd6bc8fe3d service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:37.456249 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-98929100-a473-4f26-865e-d842c5413c86 req-a4f767ea-e2b8-4f19-9867-24bd6bc8fe3d service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:37.470565 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-98929100-a473-4f26-865e-d842c5413c86 req-a4f767ea-e2b8-4f19-9867-24bd6bc8fe3d service nova] Creating event network-vif-plugged:f22388f7-ae14-4f13-95c4-629680f0fec8 for instance d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 on hv-cinder-86248 Oct 24 13:16:37.476299 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-98929100-a473-4f26-865e-d842c5413c86 req-a4f767ea-e2b8-4f19-9867-24bd6bc8fe3d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037865 Oct 24 13:16:37.477200 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 294/578] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:16:37.497482 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-563fd990-89c1-4151-8986-482518c3ff8f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:37.499872 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-563fd990-89c1-4151-8986-482518c3ff8f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:37.507202 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-563fd990-89c1-4151-8986-482518c3ff8f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:37.507765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-563fd990-89c1-4151-8986-482518c3ff8f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:37.508874 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-563fd990-89c1-4151-8986-482518c3ff8f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:37.509645 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-563fd990-89c1-4151-8986-482518c3ff8f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:37.510168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-563fd990-89c1-4151-8986-482518c3ff8f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:37.510915 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-563fd990-89c1-4151-8986-482518c3ff8f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:37.542055 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-563fd990-89c1-4151-8986-482518c3ff8f tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049412 Oct 24 13:16:37.542606 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 285/579] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Oct 24 13:16:37 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:16:38.222034 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-14893eac-02f4-4685-a2e5-6aae725c0a4f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:38.222787 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-14893eac-02f4-4685-a2e5-6aae725c0a4f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:38.230309 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-14893eac-02f4-4685-a2e5-6aae725c0a4f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:38.230787 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-14893eac-02f4-4685-a2e5-6aae725c0a4f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:38.231283 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-14893eac-02f4-4685-a2e5-6aae725c0a4f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:38.231971 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-14893eac-02f4-4685-a2e5-6aae725c0a4f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:38.232423 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-14893eac-02f4-4685-a2e5-6aae725c0a4f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:38.232848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-14893eac-02f4-4685-a2e5-6aae725c0a4f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:38.276492 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-165f1903-1c70-4655-9ce0-fa21bbc90371 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:38.277104 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-165f1903-1c70-4655-9ce0-fa21bbc90371 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:38.282908 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-165f1903-1c70-4655-9ce0-fa21bbc90371 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:38.283415 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-165f1903-1c70-4655-9ce0-fa21bbc90371 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:38.283843 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-165f1903-1c70-4655-9ce0-fa21bbc90371 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:38.284521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-165f1903-1c70-4655-9ce0-fa21bbc90371 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:38.284969 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-165f1903-1c70-4655-9ce0-fa21bbc90371 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:38.285389 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-165f1903-1c70-4655-9ce0-fa21bbc90371 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:38.370815 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-14893eac-02f4-4685-a2e5-6aae725c0a4f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:38.378463 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-14893eac-02f4-4685-a2e5-6aae725c0a4f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1677 microversion: 2.1 time: 0.160529 Oct 24 13:16:38.379023 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 295/580] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:38 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:38.421578 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-165f1903-1c70-4655-9ce0-fa21bbc90371 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:38.429636 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-165f1903-1c70-4655-9ce0-fa21bbc90371 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1724 microversion: 2.1 time: 0.158153 Oct 24 13:16:38.430618 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 286/581] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:38 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:38.443915 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-82bc77b9-d429-4e75-ae64-a949d1d09a64 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:38.444630 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-82bc77b9-d429-4e75-ae64-a949d1d09a64 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:38.450666 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-82bc77b9-d429-4e75-ae64-a949d1d09a64 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:38.451171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-82bc77b9-d429-4e75-ae64-a949d1d09a64 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:38.451608 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-82bc77b9-d429-4e75-ae64-a949d1d09a64 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:38.452293 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-82bc77b9-d429-4e75-ae64-a949d1d09a64 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:38.452743 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-82bc77b9-d429-4e75-ae64-a949d1d09a64 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:38.453161 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-82bc77b9-d429-4e75-ae64-a949d1d09a64 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:38.554557 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-574c31c1-6e2c-4c1e-a16e-43e483de402c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:38.557032 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-574c31c1-6e2c-4c1e-a16e-43e483de402c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:38.563923 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-574c31c1-6e2c-4c1e-a16e-43e483de402c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:38.564411 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-574c31c1-6e2c-4c1e-a16e-43e483de402c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:38.564849 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-574c31c1-6e2c-4c1e-a16e-43e483de402c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:38.565556 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-574c31c1-6e2c-4c1e-a16e-43e483de402c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:38.566012 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-574c31c1-6e2c-4c1e-a16e-43e483de402c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:38.566438 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-574c31c1-6e2c-4c1e-a16e-43e483de402c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:38.584874 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-82bc77b9-d429-4e75-ae64-a949d1d09a64 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:38.593290 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-82bc77b9-d429-4e75-ae64-a949d1d09a64 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5" status: 200 len: 1366 microversion: 2.1 time: 0.153041 Oct 24 13:16:38.593861 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 296/582] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:38 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:38.599978 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-574c31c1-6e2c-4c1e-a16e-43e483de402c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049877 Oct 24 13:16:38.600600 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 287/583] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Oct 24 13:16:38 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 24 13:16:39.403378 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-573b791b-6f09-48d7-bead-ee80ffa845a3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:39.403986 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-573b791b-6f09-48d7-bead-ee80ffa845a3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:39.410282 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-573b791b-6f09-48d7-bead-ee80ffa845a3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:39.410804 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-573b791b-6f09-48d7-bead-ee80ffa845a3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:39.411262 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-573b791b-6f09-48d7-bead-ee80ffa845a3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:39.411950 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-573b791b-6f09-48d7-bead-ee80ffa845a3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:39.412403 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-573b791b-6f09-48d7-bead-ee80ffa845a3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:39.412825 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-573b791b-6f09-48d7-bead-ee80ffa845a3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:39.452727 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-4102da63-f055-4db0-ae21-6a9291c9407b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:39.453335 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-4102da63-f055-4db0-ae21-6a9291c9407b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:39.459402 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4102da63-f055-4db0-ae21-6a9291c9407b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:39.459886 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4102da63-f055-4db0-ae21-6a9291c9407b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:39.460323 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4102da63-f055-4db0-ae21-6a9291c9407b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:39.461015 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4102da63-f055-4db0-ae21-6a9291c9407b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:39.461476 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4102da63-f055-4db0-ae21-6a9291c9407b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:39.462058 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4102da63-f055-4db0-ae21-6a9291c9407b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:39.543704 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-573b791b-6f09-48d7-bead-ee80ffa845a3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:39.551553 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-573b791b-6f09-48d7-bead-ee80ffa845a3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1677 microversion: 2.1 time: 0.152082 Oct 24 13:16:39.552123 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 297/584] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:39 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:39.592343 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-4102da63-f055-4db0-ae21-6a9291c9407b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:39.600467 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-4102da63-f055-4db0-ae21-6a9291c9407b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1724 microversion: 2.1 time: 0.151511 Oct 24 13:16:39.601034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 288/585] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:39 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:39.613150 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-b67445af-6d9d-45bc-a03e-a7529f51247a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:39.615571 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-b67445af-6d9d-45bc-a03e-a7529f51247a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:39.616675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-4827fed8-9a80-4e12-962f-b0405ad6a1b4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:39.617952 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-4827fed8-9a80-4e12-962f-b0405ad6a1b4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:39.619716 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:39.622943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b67445af-6d9d-45bc-a03e-a7529f51247a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:39.623537 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b67445af-6d9d-45bc-a03e-a7529f51247a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:39.624047 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b67445af-6d9d-45bc-a03e-a7529f51247a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:39.624817 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b67445af-6d9d-45bc-a03e-a7529f51247a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:39.624917 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4827fed8-9a80-4e12-962f-b0405ad6a1b4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:39.625302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4827fed8-9a80-4e12-962f-b0405ad6a1b4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:39.625470 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b67445af-6d9d-45bc-a03e-a7529f51247a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:39.625826 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4827fed8-9a80-4e12-962f-b0405ad6a1b4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:39.626018 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b67445af-6d9d-45bc-a03e-a7529f51247a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:39.626456 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4827fed8-9a80-4e12-962f-b0405ad6a1b4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:39.626908 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4827fed8-9a80-4e12-962f-b0405ad6a1b4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:39.627352 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4827fed8-9a80-4e12-962f-b0405ad6a1b4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:39.656830 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-b67445af-6d9d-45bc-a03e-a7529f51247a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047848 Oct 24 13:16:39.657300 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 298/586] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Oct 24 13:16:39 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:16:39.759635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-4827fed8-9a80-4e12-962f-b0405ad6a1b4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:39.767433 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-4827fed8-9a80-4e12-962f-b0405ad6a1b4 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5" status: 200 len: 1366 microversion: 2.1 time: 0.154454 Oct 24 13:16:39.767996 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 289/587] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:39 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:40.575712 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-bf355c20-6070-4c9d-80a7-9433cd9f0211 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:40.576229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-bf355c20-6070-4c9d-80a7-9433cd9f0211 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:40.582634 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bf355c20-6070-4c9d-80a7-9433cd9f0211 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:40.583143 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bf355c20-6070-4c9d-80a7-9433cd9f0211 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:40.583580 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bf355c20-6070-4c9d-80a7-9433cd9f0211 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:40.584267 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bf355c20-6070-4c9d-80a7-9433cd9f0211 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:40.584717 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bf355c20-6070-4c9d-80a7-9433cd9f0211 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:40.585137 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bf355c20-6070-4c9d-80a7-9433cd9f0211 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:40.624253 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-f76b6a85-1fda-47c7-b1a2-5f0d7e9512c6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:40.624855 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-f76b6a85-1fda-47c7-b1a2-5f0d7e9512c6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:40.631575 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f76b6a85-1fda-47c7-b1a2-5f0d7e9512c6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:40.632272 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f76b6a85-1fda-47c7-b1a2-5f0d7e9512c6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:40.632908 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f76b6a85-1fda-47c7-b1a2-5f0d7e9512c6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:40.633998 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f76b6a85-1fda-47c7-b1a2-5f0d7e9512c6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:40.634613 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f76b6a85-1fda-47c7-b1a2-5f0d7e9512c6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:40.635219 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f76b6a85-1fda-47c7-b1a2-5f0d7e9512c6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:40.733430 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-bf355c20-6070-4c9d-80a7-9433cd9f0211 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:40.741864 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-bf355c20-6070-4c9d-80a7-9433cd9f0211 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1677 microversion: 2.1 time: 0.170080 Oct 24 13:16:40.742572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 299/588] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:40 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:40.747379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-8483f27d-fb40-415e-9107-ffd3d59ff3c7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:40.749922 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-8483f27d-fb40-415e-9107-ffd3d59ff3c7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:40.755363 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8483f27d-fb40-415e-9107-ffd3d59ff3c7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:40.755913 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8483f27d-fb40-415e-9107-ffd3d59ff3c7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:40.756404 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8483f27d-fb40-415e-9107-ffd3d59ff3c7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:40.757151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8483f27d-fb40-415e-9107-ffd3d59ff3c7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:40.757662 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8483f27d-fb40-415e-9107-ffd3d59ff3c7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:40.758337 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8483f27d-fb40-415e-9107-ffd3d59ff3c7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:40.769714 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-f76b6a85-1fda-47c7-b1a2-5f0d7e9512c6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:40.778754 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-f76b6a85-1fda-47c7-b1a2-5f0d7e9512c6 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1724 microversion: 2.1 time: 0.158318 Oct 24 13:16:40.779440 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 290/589] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:40 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:40.790237 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-8483f27d-fb40-415e-9107-ffd3d59ff3c7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044938 Oct 24 13:16:40.790237 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 300/590] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Oct 24 13:16:40 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:16:40.790573 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-1d08ca75-4abe-4906-8405-1397a82caad1 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:40.791368 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-1d08ca75-4abe-4906-8405-1397a82caad1 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:40.799212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d08ca75-4abe-4906-8405-1397a82caad1 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:40.799932 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d08ca75-4abe-4906-8405-1397a82caad1 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:40.800400 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d08ca75-4abe-4906-8405-1397a82caad1 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:40.801173 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d08ca75-4abe-4906-8405-1397a82caad1 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:40.801637 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d08ca75-4abe-4906-8405-1397a82caad1 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:40.802063 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d08ca75-4abe-4906-8405-1397a82caad1 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:40.938568 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-1d08ca75-4abe-4906-8405-1397a82caad1 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:40.947643 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-1d08ca75-4abe-4906-8405-1397a82caad1 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5" status: 200 len: 1555 microversion: 2.1 time: 0.161939 Oct 24 13:16:40.948216 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 291/591] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:40 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:40.971892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-6c08a181-d2e2-4278-8a7e-ba7a6fca6887 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:40.972367 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-6c08a181-d2e2-4278-8a7e-ba7a6fca6887 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:40.978355 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6c08a181-d2e2-4278-8a7e-ba7a6fca6887 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:40.978829 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6c08a181-d2e2-4278-8a7e-ba7a6fca6887 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:40.979290 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6c08a181-d2e2-4278-8a7e-ba7a6fca6887 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:40.979967 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6c08a181-d2e2-4278-8a7e-ba7a6fca6887 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:40.980418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6c08a181-d2e2-4278-8a7e-ba7a6fca6887 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:40.980835 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6c08a181-d2e2-4278-8a7e-ba7a6fca6887 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:41.058552 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-6c08a181-d2e2-4278-8a7e-ba7a6fca6887 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090578 Oct 24 13:16:41.059172 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 301/592] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Oct 24 13:16:40 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:16:41.767303 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-b81445cf-1e7d-43c7-88c9-6bb320fc5b0a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:41.768034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-b81445cf-1e7d-43c7-88c9-6bb320fc5b0a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:41.776001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b81445cf-1e7d-43c7-88c9-6bb320fc5b0a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:41.776498 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b81445cf-1e7d-43c7-88c9-6bb320fc5b0a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:41.776931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b81445cf-1e7d-43c7-88c9-6bb320fc5b0a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:41.777658 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b81445cf-1e7d-43c7-88c9-6bb320fc5b0a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:41.778138 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b81445cf-1e7d-43c7-88c9-6bb320fc5b0a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:41.778559 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b81445cf-1e7d-43c7-88c9-6bb320fc5b0a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:41.804106 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-08530c0e-7be3-4333-b20e-83f3763a4073 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:41.806819 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-08530c0e-7be3-4333-b20e-83f3763a4073 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:41.813309 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08530c0e-7be3-4333-b20e-83f3763a4073 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:41.813935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08530c0e-7be3-4333-b20e-83f3763a4073 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:41.814462 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08530c0e-7be3-4333-b20e-83f3763a4073 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:41.815560 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08530c0e-7be3-4333-b20e-83f3763a4073 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:41.816103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08530c0e-7be3-4333-b20e-83f3763a4073 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:41.816699 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08530c0e-7be3-4333-b20e-83f3763a4073 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:41.849695 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-08530c0e-7be3-4333-b20e-83f3763a4073 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050181 Oct 24 13:16:41.850330 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 302/593] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Oct 24 13:16:41 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:16:41.855591 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-2f31bf5f-a6f1-4006-9aa1-1ef344448548 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:41.856202 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-2f31bf5f-a6f1-4006-9aa1-1ef344448548 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:41.862237 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f31bf5f-a6f1-4006-9aa1-1ef344448548 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:41.862723 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f31bf5f-a6f1-4006-9aa1-1ef344448548 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:41.863180 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f31bf5f-a6f1-4006-9aa1-1ef344448548 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:41.863875 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f31bf5f-a6f1-4006-9aa1-1ef344448548 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:41.864323 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f31bf5f-a6f1-4006-9aa1-1ef344448548 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:41.864741 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f31bf5f-a6f1-4006-9aa1-1ef344448548 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:42.019255 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-2f31bf5f-a6f1-4006-9aa1-1ef344448548 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:42.027940 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-2f31bf5f-a6f1-4006-9aa1-1ef344448548 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1730 microversion: 2.1 time: 0.176621 Oct 24 13:16:42.028524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 303/594] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:41 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:42.050710 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-684bab5b-9266-4e25-a1f0-7091f28f2d3a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:42.051235 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-684bab5b-9266-4e25-a1f0-7091f28f2d3a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:42.057873 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-684bab5b-9266-4e25-a1f0-7091f28f2d3a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:42.058363 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-684bab5b-9266-4e25-a1f0-7091f28f2d3a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:42.058798 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-684bab5b-9266-4e25-a1f0-7091f28f2d3a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:42.059520 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-684bab5b-9266-4e25-a1f0-7091f28f2d3a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:42.059975 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-684bab5b-9266-4e25-a1f0-7091f28f2d3a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:42.060403 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-684bab5b-9266-4e25-a1f0-7091f28f2d3a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:42.080121 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:42.150311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-684bab5b-9266-4e25-a1f0-7091f28f2d3a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103357 Oct 24 13:16:42.150919 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 304/595] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Oct 24 13:16:42 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:16:42.183832 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-b81445cf-1e7d-43c7-88c9-6bb320fc5b0a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:42.191737 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-b81445cf-1e7d-43c7-88c9-6bb320fc5b0a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1654 microversion: 2.1 time: 0.428384 Oct 24 13:16:42.192674 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 292/596] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:41 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1654 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:42.218182 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-8c8aba84-e93d-42c0-bea4-9893b3bc8b41 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:42.224924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8c8aba84-e93d-42c0-bea4-9893b3bc8b41 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:42.225571 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8c8aba84-e93d-42c0-bea4-9893b3bc8b41 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:42.226075 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8c8aba84-e93d-42c0-bea4-9893b3bc8b41 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:42.249850 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-8c8aba84-e93d-42c0-bea4-9893b3bc8b41 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Going to try to start instance {{(pid=118914) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 24 13:16:42.302492 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-8c8aba84-e93d-42c0-bea4-9893b3bc8b41 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "POST /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf/action" status: 202 len: 0 microversion: 2.1 time: 0.089135 Oct 24 13:16:42.303489 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 305/597] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 24 13:16:42 2022] POST /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 13:16:42.313000 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-f4869e6d-0cef-435f-936b-00347ae294fa tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:42.314475 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-f4869e6d-0cef-435f-936b-00347ae294fa tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:42.323340 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f4869e6d-0cef-435f-936b-00347ae294fa tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:42.324087 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f4869e6d-0cef-435f-936b-00347ae294fa tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:42.324517 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f4869e6d-0cef-435f-936b-00347ae294fa tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:42.325407 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f4869e6d-0cef-435f-936b-00347ae294fa tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:42.326019 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f4869e6d-0cef-435f-936b-00347ae294fa tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:42.326600 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f4869e6d-0cef-435f-936b-00347ae294fa tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:42.354344 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-761a408c-d35b-4cd2-9d4a-0edd137b7d58 req-574527ea-680e-456b-bd57-9796f8d134b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1f32388-2b31-4b4f-be1e-1a6b04ce35a5", "tag": "f22388f7-ae14-4f13-95c4-629680f0fec8"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:42.367886 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-761a408c-d35b-4cd2-9d4a-0edd137b7d58 req-574527ea-680e-456b-bd57-9796f8d134b5 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:42.368703 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-761a408c-d35b-4cd2-9d4a-0edd137b7d58 req-574527ea-680e-456b-bd57-9796f8d134b5 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:42.369154 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-761a408c-d35b-4cd2-9d4a-0edd137b7d58 req-574527ea-680e-456b-bd57-9796f8d134b5 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:42.383935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-761a408c-d35b-4cd2-9d4a-0edd137b7d58 req-574527ea-680e-456b-bd57-9796f8d134b5 service nova] Creating event network-changed:f22388f7-ae14-4f13-95c4-629680f0fec8 for instance d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 on hv-cinder-86248 Oct 24 13:16:42.389909 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-761a408c-d35b-4cd2-9d4a-0edd137b7d58 req-574527ea-680e-456b-bd57-9796f8d134b5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040547 Oct 24 13:16:42.390815 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 306/598] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:16:42.577131 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-f4869e6d-0cef-435f-936b-00347ae294fa tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:42.591393 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-f4869e6d-0cef-435f-936b-00347ae294fa tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1663 microversion: 2.1 time: 0.281981 Oct 24 13:16:42.592013 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 293/599] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:42 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1663 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:42.863636 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-b63456bb-25d9-4255-8818-353685001203 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:42.865916 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-b63456bb-25d9-4255-8818-353685001203 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:42.873428 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b63456bb-25d9-4255-8818-353685001203 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:42.873907 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b63456bb-25d9-4255-8818-353685001203 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:42.874330 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b63456bb-25d9-4255-8818-353685001203 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:42.875254 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b63456bb-25d9-4255-8818-353685001203 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:42.875705 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b63456bb-25d9-4255-8818-353685001203 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:42.876238 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b63456bb-25d9-4255-8818-353685001203 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:42.907432 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-b63456bb-25d9-4255-8818-353685001203 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048487 Oct 24 13:16:42.908214 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 307/600] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Oct 24 13:16:42 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:16:43.565280 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-ba15575f-21f6-4b82-b5eb-f85c384ce7e4 req-2c1de30b-6933-4f5a-b3e5-aabf8127ad0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bd238e2-4223-465c-8028-c291fe1db874", "tag": "b1289f23-07a5-45c6-9004-035914303827"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:43.595871 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-ba15575f-21f6-4b82-b5eb-f85c384ce7e4 req-2c1de30b-6933-4f5a-b3e5-aabf8127ad0d service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:43.596709 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-ba15575f-21f6-4b82-b5eb-f85c384ce7e4 req-2c1de30b-6933-4f5a-b3e5-aabf8127ad0d service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:43.597344 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-ba15575f-21f6-4b82-b5eb-f85c384ce7e4 req-2c1de30b-6933-4f5a-b3e5-aabf8127ad0d service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:43.614331 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-adfe627d-b50c-4485-8cbc-0462b81edb16 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:43.615650 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-adfe627d-b50c-4485-8cbc-0462b81edb16 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:43.622813 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-adfe627d-b50c-4485-8cbc-0462b81edb16 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:43.625914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-adfe627d-b50c-4485-8cbc-0462b81edb16 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:43.626571 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-adfe627d-b50c-4485-8cbc-0462b81edb16 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:43.628211 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-adfe627d-b50c-4485-8cbc-0462b81edb16 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:43.628708 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-adfe627d-b50c-4485-8cbc-0462b81edb16 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:43.629173 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-adfe627d-b50c-4485-8cbc-0462b81edb16 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:43.635955 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-ba15575f-21f6-4b82-b5eb-f85c384ce7e4 req-2c1de30b-6933-4f5a-b3e5-aabf8127ad0d service nova] Creating event network-changed:b1289f23-07a5-45c6-9004-035914303827 for instance 6bd238e2-4223-465c-8028-c291fe1db874 on hv-cinder-86248 Oct 24 13:16:43.653182 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-ba15575f-21f6-4b82-b5eb-f85c384ce7e4 req-2c1de30b-6933-4f5a-b3e5-aabf8127ad0d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091017 Oct 24 13:16:43.657587 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 294/601] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:16:43.916170 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-adfe627d-b50c-4485-8cbc-0462b81edb16 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:43.923079 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-6eec36d9-f2d4-4a20-acef-f6d6d1bd0e25 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:43.925387 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-6eec36d9-f2d4-4a20-acef-f6d6d1bd0e25 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:43.935806 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-adfe627d-b50c-4485-8cbc-0462b81edb16 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1663 microversion: 2.1 time: 0.324484 Oct 24 13:16:43.939746 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 308/602] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:43 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1663 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:43.940933 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6eec36d9-f2d4-4a20-acef-f6d6d1bd0e25 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:43.941438 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6eec36d9-f2d4-4a20-acef-f6d6d1bd0e25 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:43.942028 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6eec36d9-f2d4-4a20-acef-f6d6d1bd0e25 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:43.942754 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6eec36d9-f2d4-4a20-acef-f6d6d1bd0e25 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:43.943367 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6eec36d9-f2d4-4a20-acef-f6d6d1bd0e25 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:43.943664 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6eec36d9-f2d4-4a20-acef-f6d6d1bd0e25 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:43.987801 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-6eec36d9-f2d4-4a20-acef-f6d6d1bd0e25 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.070359 Oct 24 13:16:43.990154 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 295/603] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Oct 24 13:16:43 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:44.063123 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a7385e53-d50a-4317-a1fd-050aa42fb252 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:44.063574 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a7385e53-d50a-4317-a1fd-050aa42fb252 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:44.070708 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a7385e53-d50a-4317-a1fd-050aa42fb252 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:44.075801 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a7385e53-d50a-4317-a1fd-050aa42fb252 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:44.076252 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a7385e53-d50a-4317-a1fd-050aa42fb252 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:44.076996 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a7385e53-d50a-4317-a1fd-050aa42fb252 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:44.077456 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a7385e53-d50a-4317-a1fd-050aa42fb252 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:44.077881 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a7385e53-d50a-4317-a1fd-050aa42fb252 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:44.104293 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a7385e53-d50a-4317-a1fd-050aa42fb252 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Going to try to terminate instance {{(pid=118914) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:16:44.201794 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a7385e53-d50a-4317-a1fd-050aa42fb252 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "DELETE /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 204 len: 0 microversion: 2.20 time: 0.142504 Oct 24 13:16:44.202375 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 309/604] 10.222.0.42 () {60 vars in 1280 bytes} [Mon Oct 24 13:16:44 2022] DELETE /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 13:16:44.210706 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-7bd4c10a-24a5-4345-b79e-7e2f8fe8c609 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:44.211873 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-7bd4c10a-24a5-4345-b79e-7e2f8fe8c609 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:44.217797 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7bd4c10a-24a5-4345-b79e-7e2f8fe8c609 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:44.218291 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7bd4c10a-24a5-4345-b79e-7e2f8fe8c609 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:44.218730 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7bd4c10a-24a5-4345-b79e-7e2f8fe8c609 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:44.219460 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7bd4c10a-24a5-4345-b79e-7e2f8fe8c609 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:44.219920 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7bd4c10a-24a5-4345-b79e-7e2f8fe8c609 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:44.220345 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7bd4c10a-24a5-4345-b79e-7e2f8fe8c609 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:44.361744 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-7bd4c10a-24a5-4345-b79e-7e2f8fe8c609 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:44.370760 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-7bd4c10a-24a5-4345-b79e-7e2f8fe8c609 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:44.372343 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-7bd4c10a-24a5-4345-b79e-7e2f8fe8c609 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:44.373598 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-7bd4c10a-24a5-4345-b79e-7e2f8fe8c609 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1721 microversion: 2.20 time: 0.166753 Oct 24 13:16:44.384043 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 296/605] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:16:44 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:16:44.963618 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-282c6332-ecb1-4d48-abe5-5907da0d709b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:44.964315 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-282c6332-ecb1-4d48-abe5-5907da0d709b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:44.970629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-282c6332-ecb1-4d48-abe5-5907da0d709b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:44.971174 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-282c6332-ecb1-4d48-abe5-5907da0d709b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:44.971600 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-282c6332-ecb1-4d48-abe5-5907da0d709b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:44.972291 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-282c6332-ecb1-4d48-abe5-5907da0d709b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:44.972736 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-282c6332-ecb1-4d48-abe5-5907da0d709b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:44.973156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-282c6332-ecb1-4d48-abe5-5907da0d709b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:45.105660 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-282c6332-ecb1-4d48-abe5-5907da0d709b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:45.113316 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-282c6332-ecb1-4d48-abe5-5907da0d709b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1663 microversion: 2.1 time: 0.154227 Oct 24 13:16:45.113912 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 310/606] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:44 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:45.399217 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-dd868ad4-707a-4987-881c-c8ab2072aaae tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:45.399746 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-dd868ad4-707a-4987-881c-c8ab2072aaae tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:45.406084 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dd868ad4-707a-4987-881c-c8ab2072aaae tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:45.406559 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dd868ad4-707a-4987-881c-c8ab2072aaae tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:45.406986 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dd868ad4-707a-4987-881c-c8ab2072aaae tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:45.407724 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dd868ad4-707a-4987-881c-c8ab2072aaae tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:45.408172 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dd868ad4-707a-4987-881c-c8ab2072aaae tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:45.408591 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dd868ad4-707a-4987-881c-c8ab2072aaae tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:45.534788 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-dd868ad4-707a-4987-881c-c8ab2072aaae tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:45.543345 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-dd868ad4-707a-4987-881c-c8ab2072aaae tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:45.544785 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-dd868ad4-707a-4987-881c-c8ab2072aaae tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:45.545937 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-dd868ad4-707a-4987-881c-c8ab2072aaae tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1721 microversion: 2.20 time: 0.150929 Oct 24 13:16:45.546486 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 297/607] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:16:45 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:16:45.671504 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-a501bede-b12d-444d-9760-630e72572c3d req-3f093b59-ac56-4ffe-b00b-005fcb1f7a38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bd238e2-4223-465c-8028-c291fe1db874", "tag": "b1289f23-07a5-45c6-9004-035914303827"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:45.681751 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-a501bede-b12d-444d-9760-630e72572c3d req-3f093b59-ac56-4ffe-b00b-005fcb1f7a38 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:45.682218 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-a501bede-b12d-444d-9760-630e72572c3d req-3f093b59-ac56-4ffe-b00b-005fcb1f7a38 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:45.682642 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-a501bede-b12d-444d-9760-630e72572c3d req-3f093b59-ac56-4ffe-b00b-005fcb1f7a38 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:45.693118 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-a501bede-b12d-444d-9760-630e72572c3d req-3f093b59-ac56-4ffe-b00b-005fcb1f7a38 service nova] Creating event network-changed:b1289f23-07a5-45c6-9004-035914303827 for instance 6bd238e2-4223-465c-8028-c291fe1db874 on hv-cinder-86248 Oct 24 13:16:45.698285 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-a501bede-b12d-444d-9760-630e72572c3d req-3f093b59-ac56-4ffe-b00b-005fcb1f7a38 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030421 Oct 24 13:16:45.698846 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 311/608] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:16:46.137980 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-5096b994-8f81-4513-9541-7a57b6391583 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:46.138623 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-5096b994-8f81-4513-9541-7a57b6391583 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:46.144627 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5096b994-8f81-4513-9541-7a57b6391583 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:46.145100 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5096b994-8f81-4513-9541-7a57b6391583 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:46.145529 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5096b994-8f81-4513-9541-7a57b6391583 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:46.146210 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5096b994-8f81-4513-9541-7a57b6391583 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:46.146657 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5096b994-8f81-4513-9541-7a57b6391583 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:46.147122 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5096b994-8f81-4513-9541-7a57b6391583 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:46.279177 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-5096b994-8f81-4513-9541-7a57b6391583 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:46.286696 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-5096b994-8f81-4513-9541-7a57b6391583 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1663 microversion: 2.1 time: 0.152826 Oct 24 13:16:46.287281 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 298/609] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:46 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:46.573350 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a4568aae-06c1-4e48-b911-0ff28eef7859 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:46.574029 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a4568aae-06c1-4e48-b911-0ff28eef7859 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:46.580091 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4568aae-06c1-4e48-b911-0ff28eef7859 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:46.580561 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4568aae-06c1-4e48-b911-0ff28eef7859 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:46.580988 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4568aae-06c1-4e48-b911-0ff28eef7859 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:46.581663 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4568aae-06c1-4e48-b911-0ff28eef7859 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:46.582108 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4568aae-06c1-4e48-b911-0ff28eef7859 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:46.582522 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4568aae-06c1-4e48-b911-0ff28eef7859 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:46.713685 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a4568aae-06c1-4e48-b911-0ff28eef7859 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:46.721592 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a4568aae-06c1-4e48-b911-0ff28eef7859 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:46.723007 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a4568aae-06c1-4e48-b911-0ff28eef7859 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:46.724169 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a4568aae-06c1-4e48-b911-0ff28eef7859 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1721 microversion: 2.20 time: 0.156495 Oct 24 13:16:46.724717 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 312/610] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:16:46 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:16:47.309800 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-79306c22-8bc3-4e25-8886-56299a4505e8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:47.310413 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-79306c22-8bc3-4e25-8886-56299a4505e8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:47.316898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79306c22-8bc3-4e25-8886-56299a4505e8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:47.317384 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79306c22-8bc3-4e25-8886-56299a4505e8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:47.317820 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79306c22-8bc3-4e25-8886-56299a4505e8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:47.318506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79306c22-8bc3-4e25-8886-56299a4505e8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:47.318960 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79306c22-8bc3-4e25-8886-56299a4505e8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:47.319422 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79306c22-8bc3-4e25-8886-56299a4505e8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:47.447761 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-79306c22-8bc3-4e25-8886-56299a4505e8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:47.455549 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-79306c22-8bc3-4e25-8886-56299a4505e8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1663 microversion: 2.1 time: 0.149712 Oct 24 13:16:47.456104 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 299/611] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:47 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1663 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:47.748801 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-55f1ec37-e5f6-4e93-9b70-d04b872834aa tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:47.749415 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-55f1ec37-e5f6-4e93-9b70-d04b872834aa tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:47.755984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-55f1ec37-e5f6-4e93-9b70-d04b872834aa tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:47.756458 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-55f1ec37-e5f6-4e93-9b70-d04b872834aa tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:47.756884 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-55f1ec37-e5f6-4e93-9b70-d04b872834aa tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:47.757612 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-55f1ec37-e5f6-4e93-9b70-d04b872834aa tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:47.758568 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-55f1ec37-e5f6-4e93-9b70-d04b872834aa tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:47.758989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-55f1ec37-e5f6-4e93-9b70-d04b872834aa tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:47.888467 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-55f1ec37-e5f6-4e93-9b70-d04b872834aa tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:47.896435 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-55f1ec37-e5f6-4e93-9b70-d04b872834aa tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:47.897902 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-55f1ec37-e5f6-4e93-9b70-d04b872834aa tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:47.899202 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-55f1ec37-e5f6-4e93-9b70-d04b872834aa tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1721 microversion: 2.20 time: 0.154232 Oct 24 13:16:47.899758 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 313/612] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:16:47 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:16:48.479308 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-6741b9ac-7135-4f17-ad96-8ae53b9df1b1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:48.479948 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-6741b9ac-7135-4f17-ad96-8ae53b9df1b1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:48.486749 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6741b9ac-7135-4f17-ad96-8ae53b9df1b1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:48.487262 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6741b9ac-7135-4f17-ad96-8ae53b9df1b1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:48.487716 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6741b9ac-7135-4f17-ad96-8ae53b9df1b1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:48.488405 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6741b9ac-7135-4f17-ad96-8ae53b9df1b1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:48.488850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6741b9ac-7135-4f17-ad96-8ae53b9df1b1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:48.489266 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6741b9ac-7135-4f17-ad96-8ae53b9df1b1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:48.620389 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-6741b9ac-7135-4f17-ad96-8ae53b9df1b1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:48.627876 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-6741b9ac-7135-4f17-ad96-8ae53b9df1b1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1663 microversion: 2.1 time: 0.152822 Oct 24 13:16:48.628436 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 300/613] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:48 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:48.925182 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d909da5f-ad3e-426d-b9a9-140803ba8dde tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:48.925786 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-d909da5f-ad3e-426d-b9a9-140803ba8dde tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:48.932841 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d909da5f-ad3e-426d-b9a9-140803ba8dde tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:48.933314 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d909da5f-ad3e-426d-b9a9-140803ba8dde tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:48.933771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d909da5f-ad3e-426d-b9a9-140803ba8dde tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:48.934451 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d909da5f-ad3e-426d-b9a9-140803ba8dde tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:48.934897 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d909da5f-ad3e-426d-b9a9-140803ba8dde tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:48.935335 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d909da5f-ad3e-426d-b9a9-140803ba8dde tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:49.064335 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-d909da5f-ad3e-426d-b9a9-140803ba8dde tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:49.073193 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-d909da5f-ad3e-426d-b9a9-140803ba8dde tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:49.074612 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-d909da5f-ad3e-426d-b9a9-140803ba8dde tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:49.075798 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-d909da5f-ad3e-426d-b9a9-140803ba8dde tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1721 microversion: 2.20 time: 0.154483 Oct 24 13:16:49.076352 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 314/614] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:16:48 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:16:49.652983 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-7bc59c00-9dd9-40c6-8062-08434ef4b0c3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:49.653594 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-7bc59c00-9dd9-40c6-8062-08434ef4b0c3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:49.660031 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7bc59c00-9dd9-40c6-8062-08434ef4b0c3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:49.660513 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7bc59c00-9dd9-40c6-8062-08434ef4b0c3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:49.660949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7bc59c00-9dd9-40c6-8062-08434ef4b0c3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:49.661634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7bc59c00-9dd9-40c6-8062-08434ef4b0c3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:49.662088 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7bc59c00-9dd9-40c6-8062-08434ef4b0c3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:49.662514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7bc59c00-9dd9-40c6-8062-08434ef4b0c3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:49.666050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=100 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:49.796176 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-7bc59c00-9dd9-40c6-8062-08434ef4b0c3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:49.803860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-7bc59c00-9dd9-40c6-8062-08434ef4b0c3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1663 microversion: 2.1 time: 0.155394 Oct 24 13:16:49.804439 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 301/615] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:49 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1663 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:50.101050 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-1e90c60e-a5d6-403a-876d-0c431a0a9f5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:50.102321 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-1e90c60e-a5d6-403a-876d-0c431a0a9f5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:50.109126 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1e90c60e-a5d6-403a-876d-0c431a0a9f5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:50.109608 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1e90c60e-a5d6-403a-876d-0c431a0a9f5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:50.110052 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1e90c60e-a5d6-403a-876d-0c431a0a9f5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:50.110746 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1e90c60e-a5d6-403a-876d-0c431a0a9f5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:50.111257 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1e90c60e-a5d6-403a-876d-0c431a0a9f5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:50.111683 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1e90c60e-a5d6-403a-876d-0c431a0a9f5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:50.240169 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-1e90c60e-a5d6-403a-876d-0c431a0a9f5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:50.248995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-1e90c60e-a5d6-403a-876d-0c431a0a9f5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:50.250436 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-1e90c60e-a5d6-403a-876d-0c431a0a9f5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:50.251635 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-1e90c60e-a5d6-403a-876d-0c431a0a9f5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1721 microversion: 2.20 time: 0.154491 Oct 24 13:16:50.252194 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 315/616] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:16:50 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:16:50.826975 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-4e308c13-484e-46cf-b79d-0b7685113e48 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:50.827609 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-4e308c13-484e-46cf-b79d-0b7685113e48 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:50.833960 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4e308c13-484e-46cf-b79d-0b7685113e48 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:50.834448 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4e308c13-484e-46cf-b79d-0b7685113e48 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:50.834883 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4e308c13-484e-46cf-b79d-0b7685113e48 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:50.835602 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4e308c13-484e-46cf-b79d-0b7685113e48 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:50.836308 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4e308c13-484e-46cf-b79d-0b7685113e48 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:50.836737 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4e308c13-484e-46cf-b79d-0b7685113e48 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:50.968094 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-4e308c13-484e-46cf-b79d-0b7685113e48 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:50.975797 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-4e308c13-484e-46cf-b79d-0b7685113e48 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1663 microversion: 2.1 time: 0.152704 Oct 24 13:16:50.976385 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 302/617] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:50 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:51.277624 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-5612cdaf-3014-46fa-b4ea-00c76dd7298a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:51.278346 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-5612cdaf-3014-46fa-b4ea-00c76dd7298a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:51.284849 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5612cdaf-3014-46fa-b4ea-00c76dd7298a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:51.285331 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5612cdaf-3014-46fa-b4ea-00c76dd7298a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:51.285763 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5612cdaf-3014-46fa-b4ea-00c76dd7298a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:51.286453 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5612cdaf-3014-46fa-b4ea-00c76dd7298a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:51.286905 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5612cdaf-3014-46fa-b4ea-00c76dd7298a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:51.287356 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5612cdaf-3014-46fa-b4ea-00c76dd7298a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:51.419557 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-5612cdaf-3014-46fa-b4ea-00c76dd7298a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:51.427859 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-5612cdaf-3014-46fa-b4ea-00c76dd7298a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:51.429291 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-5612cdaf-3014-46fa-b4ea-00c76dd7298a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:51.431124 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-5612cdaf-3014-46fa-b4ea-00c76dd7298a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1721 microversion: 2.20 time: 0.157508 Oct 24 13:16:51.431683 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 316/618] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:16:51 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:16:51.998426 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-d9c918ec-4fa9-42f6-a724-7aff61825e7a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:52.000502 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-d9c918ec-4fa9-42f6-a724-7aff61825e7a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:52.008862 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d9c918ec-4fa9-42f6-a724-7aff61825e7a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:52.009352 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d9c918ec-4fa9-42f6-a724-7aff61825e7a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:52.010857 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d9c918ec-4fa9-42f6-a724-7aff61825e7a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:52.011518 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d9c918ec-4fa9-42f6-a724-7aff61825e7a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:52.011975 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d9c918ec-4fa9-42f6-a724-7aff61825e7a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:52.012977 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d9c918ec-4fa9-42f6-a724-7aff61825e7a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:52.275482 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-d9c918ec-4fa9-42f6-a724-7aff61825e7a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:52.288554 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-d9c918ec-4fa9-42f6-a724-7aff61825e7a tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1667 microversion: 2.1 time: 0.293936 Oct 24 13:16:52.289678 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 303/619] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:51 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1667 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:52.456859 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-ce6f8c12-959e-4f69-9e95-56e0065ab2a3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:52.457379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-ce6f8c12-959e-4f69-9e95-56e0065ab2a3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:52.464495 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ce6f8c12-959e-4f69-9e95-56e0065ab2a3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:52.465235 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ce6f8c12-959e-4f69-9e95-56e0065ab2a3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:52.465739 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ce6f8c12-959e-4f69-9e95-56e0065ab2a3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:52.466672 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ce6f8c12-959e-4f69-9e95-56e0065ab2a3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:52.467319 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ce6f8c12-959e-4f69-9e95-56e0065ab2a3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:52.468143 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ce6f8c12-959e-4f69-9e95-56e0065ab2a3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:52.617202 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-ce6f8c12-959e-4f69-9e95-56e0065ab2a3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:52.625680 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-ce6f8c12-959e-4f69-9e95-56e0065ab2a3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:52.627187 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-ce6f8c12-959e-4f69-9e95-56e0065ab2a3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:52.628355 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-ce6f8c12-959e-4f69-9e95-56e0065ab2a3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1721 microversion: 2.20 time: 0.175694 Oct 24 13:16:52.628911 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 317/620] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:16:52 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:16:52.954055 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-3159b4a3-033f-4e29-9926-81ffdb96fe6a req-7649ccce-d2bf-43dd-b684-d2f97e17dc96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27b5963f-5199-4822-a8c3-20a8ab09224f", "name": "network-vif-deleted", "tag": "9241fec5-c702-4043-a917-794ed6ca4105"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:52.964455 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-3159b4a3-033f-4e29-9926-81ffdb96fe6a req-7649ccce-d2bf-43dd-b684-d2f97e17dc96 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:52.964936 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-3159b4a3-033f-4e29-9926-81ffdb96fe6a req-7649ccce-d2bf-43dd-b684-d2f97e17dc96 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:52.965363 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-3159b4a3-033f-4e29-9926-81ffdb96fe6a req-7649ccce-d2bf-43dd-b684-d2f97e17dc96 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:52.978115 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-3159b4a3-033f-4e29-9926-81ffdb96fe6a req-7649ccce-d2bf-43dd-b684-d2f97e17dc96 service nova] Creating event network-vif-deleted:9241fec5-c702-4043-a917-794ed6ca4105 for instance 27b5963f-5199-4822-a8c3-20a8ab09224f on hv-cinder-86248 Oct 24 13:16:52.983308 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-3159b4a3-033f-4e29-9926-81ffdb96fe6a req-7649ccce-d2bf-43dd-b684-d2f97e17dc96 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032788 Oct 24 13:16:52.983925 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 304/621] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:16:53.654521 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a3a58c1c-f25c-4205-b0fd-d6a192d593f3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:53.663326 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a3a58c1c-f25c-4205-b0fd-d6a192d593f3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:53.672246 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a3a58c1c-f25c-4205-b0fd-d6a192d593f3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:53.673248 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a3a58c1c-f25c-4205-b0fd-d6a192d593f3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:53.673466 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a3a58c1c-f25c-4205-b0fd-d6a192d593f3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:53.674214 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a3a58c1c-f25c-4205-b0fd-d6a192d593f3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:53.674699 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a3a58c1c-f25c-4205-b0fd-d6a192d593f3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:53.675183 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a3a58c1c-f25c-4205-b0fd-d6a192d593f3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:53.710548 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a3a58c1c-f25c-4205-b0fd-d6a192d593f3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:53.711270 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a3a58c1c-f25c-4205-b0fd-d6a192d593f3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:53.711883 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a3a58c1c-f25c-4205-b0fd-d6a192d593f3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:53.712239 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.objects.instance [None req-a3a58c1c-f25c-4205-b0fd-d6a192d593f3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lazy-loading 'fault' on Instance uuid 27b5963f-5199-4822-a8c3-20a8ab09224f {{(pid=118914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:16:53.765238 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a3a58c1c-f25c-4205-b0fd-d6a192d593f3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:53.775073 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a3a58c1c-f25c-4205-b0fd-d6a192d593f3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:53.776582 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a3a58c1c-f25c-4205-b0fd-d6a192d593f3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:53.777740 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a3a58c1c-f25c-4205-b0fd-d6a192d593f3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 200 len: 1371 microversion: 2.20 time: 0.127416 Oct 24 13:16:53.778711 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 318/622] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:16:53 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 1371 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:16:54.805827 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-447f0334-8475-4404-9744-af436ddb4f30 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:54.806469 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-447f0334-8475-4404-9744-af436ddb4f30 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:54.812509 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-447f0334-8475-4404-9744-af436ddb4f30 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:54.812981 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-447f0334-8475-4404-9744-af436ddb4f30 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:54.813408 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-447f0334-8475-4404-9744-af436ddb4f30 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:54.814082 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-447f0334-8475-4404-9744-af436ddb4f30 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:54.814525 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-447f0334-8475-4404-9744-af436ddb4f30 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:54.814938 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-447f0334-8475-4404-9744-af436ddb4f30 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:54.827784 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-447f0334-8475-4404-9744-af436ddb4f30 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] HTTP exception thrown: Instance 27b5963f-5199-4822-a8c3-20a8ab09224f could not be found. Oct 24 13:16:54.829624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-447f0334-8475-4404-9744-af436ddb4f30 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Request method failure captured: Oct 24 13:16:54.829624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f HTTP/1.1 Oct 24 13:16:54.829624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:16:54.829624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:16:54.829624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:16:54.829624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:16:54.829624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:16:54.829624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:16:54.829624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:16:54.829624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:16:54.829624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo9CWYWM4UF-UyHcTK9jrAEuWD7kYiZrWlsOb5-EbP16Pf_2_sxKAYMRnnCp8fAU3d8tio5PiGm13bpXgRLj7HBYk2HvAAI8moGL8UX4b_JXSgVZ-FvHhfjqmd2-sNxAIwSiIFkIy71RHjfpjPwPWKu_n0qMo2vAVfLTrwQ6cySdG-4 Oct 24 13:16:54.829624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:16:54.829624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:16:54.829624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:16:54.829624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:16:54.829624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 13:16:54.829624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:16:54.829624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:16:54.829624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: b736b09b6ee2492590cbc23db48752f4 Oct 24 13:16:54.829624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1585260718 Oct 24 13:16:54.829624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:16:54.829624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:16:54.831027 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:16:54.831027 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1585260718 Oct 24 13:16:54.831027 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: b736b09b6ee2492590cbc23db48752f4 Oct 24 13:16:54.831027 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1585260718 Oct 24 13:16:54.831027 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-AttachVolumeShelveTestJSON-1585260718-project Oct 24 13:16:54.831027 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:16:54.831027 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:16:54.831027 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: 3e02f6f701324af6b53762569f1a9d21 Oct 24 13:16:54.831027 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1585260718-project Oct 24 13:16:54.831027 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:16:54.831027 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Instance 27b5963f-5199-4822-a8c3-20a8ab09224f could not be found. Oct 24 13:16:54.831027 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': '27b5963f-5199-4822-a8c3-20a8ab09224f'} Oct 24 13:16:54.831796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:16:54.831796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:16:54.831796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:16:54.831796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:16:54.831796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:16:54.831796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:16:54.831796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:16:54.831796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:16:54.831796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:16:54.831796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:16:54.831796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27b5963f-5199-4822-a8c3-20a8ab09224f could not be found. Oct 24 13:16:54.831796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:16:54.831796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:16:54.831796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:16:54.831796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:16:54.831796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:16:54.831796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:16:54.831796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:16:54.831796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:16:54.831796 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:16:54.833382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:16:54.833382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:16:54.833382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:16:54.833382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:16:54.833382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:16:54.833382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:16:54.833382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:16:54.833382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27b5963f-5199-4822-a8c3-20a8ab09224f could not be found. Oct 24 13:16:54.833382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:16:54.833382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:16:54.833382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:16:54.833382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:16:54.833382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:16:54.833382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:16:54.833382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:16:54.833382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:16:54.833382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27b5963f-5199-4822-a8c3-20a8ab09224f could not be found. Oct 24 13:16:54.833382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:16:54.834715 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-447f0334-8475-4404-9744-af436ddb4f30 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Returning 404 to user: Instance 27b5963f-5199-4822-a8c3-20a8ab09224f could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:16:54.834715 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-447f0334-8475-4404-9744-af436ddb4f30 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 404 len: 111 microversion: 2.20 time: 0.030415 Oct 24 13:16:54.834715 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 305/623] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:16:54 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:16:54.841845 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-7f97c779-1b73-43a1-af95-2768d4b60904 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '.version_select at 0x7fad28446f70>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:54.862342 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-7f97c779-1b73-43a1-af95-2768d4b60904 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-989564064" status: 204 len: 0 microversion: 2.20 time: 0.024318 Oct 24 13:16:54.862910 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 319/624] 10.222.0.42 () {60 vars in 1259 bytes} [Mon Oct 24 13:16:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-989564064 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 13:16:55.486312 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-db7e136f-729b-43ae-aa38-722e15c0e07e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Action: 'create', calling method: .version_select at 0x7fad2838f8b0>, body: {"keypair": {"name": "tempest-keypair-506177972", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMU+JkvRaE07iaxW2zmoGjRPDbWUCRUWxDvNYx7j+nNDBBT9HSyweOK4vtsJUUVzGVmVYn74F04kYCwHWxG+pJHmkJoOQbEHQoBskNvHU4acwyh0ibc8x03UyA0zLWU2w=="}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:55.501985 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-db7e136f-729b-43ae-aa38-722e15c0e07e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Getting quotas for project b736b09b6ee2492590cbc23db48752f4. Resources: {'key_pairs'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:16:55.505827 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-db7e136f-729b-43ae-aa38-722e15c0e07e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Getting quotas for user 3e02f6f701324af6b53762569f1a9d21 and project b736b09b6ee2492590cbc23db48752f4. Resources: {'key_pairs'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:16:55.528756 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-db7e136f-729b-43ae-aa38-722e15c0e07e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046359 Oct 24 13:16:55.529343 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 306/625] 10.222.0.42 () {62 vars in 1200 bytes} [Mon Oct 24 13:16:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 24 13:16:55.647604 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-cd82c8a6-6cd1-4ad7-b63a-c47d6c5e68ea tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:55.649234 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-cd82c8a6-6cd1-4ad7-b63a-c47d6c5e68ea tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 464765b9-dece-4c4b-b84b-9361ad82ac88] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:55.655296 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cd82c8a6-6cd1-4ad7-b63a-c47d6c5e68ea tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:55.655775 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cd82c8a6-6cd1-4ad7-b63a-c47d6c5e68ea tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:55.656200 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cd82c8a6-6cd1-4ad7-b63a-c47d6c5e68ea tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:55.656881 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cd82c8a6-6cd1-4ad7-b63a-c47d6c5e68ea tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:55.657331 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cd82c8a6-6cd1-4ad7-b63a-c47d6c5e68ea tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:55.657743 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cd82c8a6-6cd1-4ad7-b63a-c47d6c5e68ea tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:55.677922 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:55.751535 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.objects.instance [None req-cd82c8a6-6cd1-4ad7-b63a-c47d6c5e68ea tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lazy-loading 'services' on Instance uuid 464765b9-dece-4c4b-b84b-9361ad82ac88 {{(pid=118914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:16:55.846643 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-cd82c8a6-6cd1-4ad7-b63a-c47d6c5e68ea tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "DELETE /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88/os-volume_attachments/1a17c68f-94de-4b1d-861f-d77200259994" status: 202 len: 0 microversion: 2.1 time: 0.202718 Oct 24 13:16:55.847426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 320/626] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 24 13:16:55 2022] DELETE /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88/os-volume_attachments/1a17c68f-94de-4b1d-861f-d77200259994 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:16:56.859995 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-b18889ac-f611-45ee-9287-266189a773a6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-854477599", "imageRef": "4d2e5f3e-4aee-48d2-8ada-0b420d141f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5d6737bc-d513-4e59-9015-d238c58ac0c3"}], "security_groups": [{"name": "tempest-securitygroup--1300846335"}], "key_name": "tempest-keypair-506177972", "user_data": "}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:56.966065 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.network.neutron [None req-b18889ac-f611-45ee-9287-266189a773a6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] validate_networks() for [('5d6737bc-d513-4e59-9015-d238c58ac0c3', None, None, None, None, None)] {{(pid=118915) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:16:56.972663 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-0821caa4-df7e-43f2-ba9b-90327cba16ac tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:56.973317 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-0821caa4-df7e-43f2-ba9b-90327cba16ac tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 464765b9-dece-4c4b-b84b-9361ad82ac88] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:56.980631 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0821caa4-df7e-43f2-ba9b-90327cba16ac tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:56.981209 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0821caa4-df7e-43f2-ba9b-90327cba16ac tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:56.981744 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0821caa4-df7e-43f2-ba9b-90327cba16ac tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:56.982494 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0821caa4-df7e-43f2-ba9b-90327cba16ac tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:56.983012 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0821caa4-df7e-43f2-ba9b-90327cba16ac tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:56.983518 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0821caa4-df7e-43f2-ba9b-90327cba16ac tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:57.009505 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-0821caa4-df7e-43f2-ba9b-90327cba16ac tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 464765b9-dece-4c4b-b84b-9361ad82ac88] Going to try to terminate instance {{(pid=118914) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:16:57.089495 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-0821caa4-df7e-43f2-ba9b-90327cba16ac tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "DELETE /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88" status: 204 len: 0 microversion: 2.1 time: 0.121174 Oct 24 13:16:57.090085 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 321/627] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:16:56 2022] DELETE /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 13:16:57.103146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a6f3ba72-aa8b-413d-9c6d-408b07b01a2f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:57.103850 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a6f3ba72-aa8b-413d-9c6d-408b07b01a2f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 464765b9-dece-4c4b-b84b-9361ad82ac88] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:57.109721 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a6f3ba72-aa8b-413d-9c6d-408b07b01a2f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:57.110195 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a6f3ba72-aa8b-413d-9c6d-408b07b01a2f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:57.110621 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a6f3ba72-aa8b-413d-9c6d-408b07b01a2f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:57.111328 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a6f3ba72-aa8b-413d-9c6d-408b07b01a2f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:57.111774 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a6f3ba72-aa8b-413d-9c6d-408b07b01a2f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:57.112195 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a6f3ba72-aa8b-413d-9c6d-408b07b01a2f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:57.245806 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a6f3ba72-aa8b-413d-9c6d-408b07b01a2f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:57.253557 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a6f3ba72-aa8b-413d-9c6d-408b07b01a2f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88" status: 200 len: 1514 microversion: 2.1 time: 0.158707 Oct 24 13:16:57.254128 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 322/628] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:57 2022] GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:16:57.569893 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-b18889ac-f611-45ee-9287-266189a773a6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Flavor limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:16:57.570314 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-b18889ac-f611-45ee-9287-266189a773a6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Image limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:16:57.570806 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-b18889ac-f611-45ee-9287-266189a773a6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Flavor pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:16:57.571242 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-b18889ac-f611-45ee-9287-266189a773a6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Image pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:16:57.571645 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-b18889ac-f611-45ee-9287-266189a773a6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:16:57.580244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b18889ac-f611-45ee-9287-266189a773a6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:57.580638 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b18889ac-f611-45ee-9287-266189a773a6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:57.581063 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b18889ac-f611-45ee-9287-266189a773a6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:57.581767 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b18889ac-f611-45ee-9287-266189a773a6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:57.582209 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b18889ac-f611-45ee-9287-266189a773a6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:57.582645 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b18889ac-f611-45ee-9287-266189a773a6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:57.598473 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-b18889ac-f611-45ee-9287-266189a773a6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Getting quotas for project b736b09b6ee2492590cbc23db48752f4. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:16:57.603015 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-b18889ac-f611-45ee-9287-266189a773a6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Getting quotas for user 3e02f6f701324af6b53762569f1a9d21 and project b736b09b6ee2492590cbc23db48752f4. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:16:57.613592 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-b18889ac-f611-45ee-9287-266189a773a6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Going to run 1 instances... {{(pid=118915) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:16:57.615880 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-b18889ac-f611-45ee-9287-266189a773a6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4d2e5f3e-4aee-48d2-8ada-0b420d141f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:16:57.664058 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-b18889ac-f611-45ee-9287-266189a773a6 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.807786 Oct 24 13:16:57.664705 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 307/629] 10.222.0.42 () {62 vars in 1188 bytes} [Mon Oct 24 13:16:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 24 13:16:57.676127 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-733caa8d-e9ae-4b43-9267-6ce90ca93066 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:57.676840 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-733caa8d-e9ae-4b43-9267-6ce90ca93066 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:57.729954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-733caa8d-e9ae-4b43-9267-6ce90ca93066 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:57.737081 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-733caa8d-e9ae-4b43-9267-6ce90ca93066 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:57.738513 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-733caa8d-e9ae-4b43-9267-6ce90ca93066 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:57.740304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-733caa8d-e9ae-4b43-9267-6ce90ca93066 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1280 microversion: 2.20 time: 0.068110 Oct 24 13:16:57.740891 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 323/630] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:16:57 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:16:58.277236 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9bb94ac0-a5ae-4164-8268-8e755a5fb1e5 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:58.277839 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9bb94ac0-a5ae-4164-8268-8e755a5fb1e5 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 464765b9-dece-4c4b-b84b-9361ad82ac88] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:58.284805 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9bb94ac0-a5ae-4164-8268-8e755a5fb1e5 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:58.285288 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9bb94ac0-a5ae-4164-8268-8e755a5fb1e5 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:58.285722 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9bb94ac0-a5ae-4164-8268-8e755a5fb1e5 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:58.286433 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9bb94ac0-a5ae-4164-8268-8e755a5fb1e5 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:58.286884 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9bb94ac0-a5ae-4164-8268-8e755a5fb1e5 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:58.287336 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9bb94ac0-a5ae-4164-8268-8e755a5fb1e5 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:58.417992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-9bb94ac0-a5ae-4164-8268-8e755a5fb1e5 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:58.425588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-9bb94ac0-a5ae-4164-8268-8e755a5fb1e5 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88" status: 200 len: 1514 microversion: 2.1 time: 0.153255 Oct 24 13:16:58.426143 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 308/631] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:58 2022] GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:58.765389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-5c664c73-83f1-4726-a22a-c5dcef4a50bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:58.765997 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-5c664c73-83f1-4726-a22a-c5dcef4a50bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:58.773205 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5c664c73-83f1-4726-a22a-c5dcef4a50bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:58.773829 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5c664c73-83f1-4726-a22a-c5dcef4a50bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:58.774083 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5c664c73-83f1-4726-a22a-c5dcef4a50bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:58.774775 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5c664c73-83f1-4726-a22a-c5dcef4a50bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:58.775255 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5c664c73-83f1-4726-a22a-c5dcef4a50bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:58.775679 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5c664c73-83f1-4726-a22a-c5dcef4a50bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:58.837666 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-5c664c73-83f1-4726-a22a-c5dcef4a50bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:58.845688 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-5c664c73-83f1-4726-a22a-c5dcef4a50bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:58.847236 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-5c664c73-83f1-4726-a22a-c5dcef4a50bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:58.848328 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-5c664c73-83f1-4726-a22a-c5dcef4a50bb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1284 microversion: 2.20 time: 0.086884 Oct 24 13:16:58.848885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 324/632] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:16:58 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:16:59.448709 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-1866e55b-1e94-4256-9076-1db5d32afb22 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:59.449622 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-1866e55b-1e94-4256-9076-1db5d32afb22 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 464765b9-dece-4c4b-b84b-9361ad82ac88] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:59.457074 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1866e55b-1e94-4256-9076-1db5d32afb22 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:59.457577 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1866e55b-1e94-4256-9076-1db5d32afb22 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:59.458065 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1866e55b-1e94-4256-9076-1db5d32afb22 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:59.458964 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1866e55b-1e94-4256-9076-1db5d32afb22 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:59.459453 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1866e55b-1e94-4256-9076-1db5d32afb22 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:59.459904 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1866e55b-1e94-4256-9076-1db5d32afb22 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:59.531249 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-1866e55b-1e94-4256-9076-1db5d32afb22 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:59.539875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-1866e55b-1e94-4256-9076-1db5d32afb22 tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88" status: 200 len: 1472 microversion: 2.1 time: 0.095184 Oct 24 13:16:59.540411 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 309/633] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:16:59 2022] GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88 => generated 1472 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:16:59.579388 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-ab73b368-9cc9-44ee-a66f-8df8b186c395 req-db7be08e-91a7-4b01-a3e1-b8463676dea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "464765b9-dece-4c4b-b84b-9361ad82ac88", "name": "network-vif-deleted", "tag": "3a4966df-5594-432c-b7ff-77cf8ebddc41"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:16:59.584350 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:16:59.590174 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-ab73b368-9cc9-44ee-a66f-8df8b186c395 req-db7be08e-91a7-4b01-a3e1-b8463676dea4 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:59.590651 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-ab73b368-9cc9-44ee-a66f-8df8b186c395 req-db7be08e-91a7-4b01-a3e1-b8463676dea4 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:59.591102 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-ab73b368-9cc9-44ee-a66f-8df8b186c395 req-db7be08e-91a7-4b01-a3e1-b8463676dea4 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:59.603665 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-ab73b368-9cc9-44ee-a66f-8df8b186c395 req-db7be08e-91a7-4b01-a3e1-b8463676dea4 service nova] Creating event network-vif-deleted:3a4966df-5594-432c-b7ff-77cf8ebddc41 for instance 464765b9-dece-4c4b-b84b-9361ad82ac88 on hv-cinder-86248 Oct 24 13:16:59.608809 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-ab73b368-9cc9-44ee-a66f-8df8b186c395 req-db7be08e-91a7-4b01-a3e1-b8463676dea4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033195 Oct 24 13:16:59.609390 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 325/634] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:16:59.875648 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-bbd41d5a-6368-4b89-9230-04d4c7a38aaf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:16:59.877199 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-bbd41d5a-6368-4b89-9230-04d4c7a38aaf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:16:59.885738 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bbd41d5a-6368-4b89-9230-04d4c7a38aaf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:59.886261 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bbd41d5a-6368-4b89-9230-04d4c7a38aaf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:59.886930 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bbd41d5a-6368-4b89-9230-04d4c7a38aaf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:59.887685 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bbd41d5a-6368-4b89-9230-04d4c7a38aaf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:16:59.888142 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bbd41d5a-6368-4b89-9230-04d4c7a38aaf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:16:59.888562 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bbd41d5a-6368-4b89-9230-04d4c7a38aaf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:16:59.964881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-bbd41d5a-6368-4b89-9230-04d4c7a38aaf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:59.973414 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-bbd41d5a-6368-4b89-9230-04d4c7a38aaf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:59.975123 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-bbd41d5a-6368-4b89-9230-04d4c7a38aaf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:16:59.977052 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-bbd41d5a-6368-4b89-9230-04d4c7a38aaf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1350 microversion: 2.20 time: 0.106950 Oct 24 13:16:59.977950 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 310/635] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:16:59 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1350 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:17:00.564950 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-68d359a0-b243-492b-ac0a-760c7dd3e89c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:00.565655 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-68d359a0-b243-492b-ac0a-760c7dd3e89c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 464765b9-dece-4c4b-b84b-9361ad82ac88] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:00.575694 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-68d359a0-b243-492b-ac0a-760c7dd3e89c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:00.576015 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-68d359a0-b243-492b-ac0a-760c7dd3e89c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:00.576435 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-68d359a0-b243-492b-ac0a-760c7dd3e89c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:00.577482 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-68d359a0-b243-492b-ac0a-760c7dd3e89c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:00.588175 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-68d359a0-b243-492b-ac0a-760c7dd3e89c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:00.588640 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-68d359a0-b243-492b-ac0a-760c7dd3e89c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:00.629926 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-68d359a0-b243-492b-ac0a-760c7dd3e89c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:00.630483 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-68d359a0-b243-492b-ac0a-760c7dd3e89c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:00.631252 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-68d359a0-b243-492b-ac0a-760c7dd3e89c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:00.632107 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.objects.instance [None req-68d359a0-b243-492b-ac0a-760c7dd3e89c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lazy-loading 'fault' on Instance uuid 464765b9-dece-4c4b-b84b-9361ad82ac88 {{(pid=118914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:17:00.693026 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-68d359a0-b243-492b-ac0a-760c7dd3e89c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd7bde497c14d25a06c276609aa143f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027aba5a38b422fbc30d64b9ee2ef79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:00.702310 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-68d359a0-b243-492b-ac0a-760c7dd3e89c tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88" status: 200 len: 1308 microversion: 2.1 time: 0.141925 Oct 24 13:17:00.702924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 326/636] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:00 2022] GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88 => generated 1308 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:01.002193 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-b58bb059-3689-4bdb-adbc-10dac8eb9544 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:01.002804 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-b58bb059-3689-4bdb-adbc-10dac8eb9544 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:01.009765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b58bb059-3689-4bdb-adbc-10dac8eb9544 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:01.010245 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b58bb059-3689-4bdb-adbc-10dac8eb9544 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:01.010927 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b58bb059-3689-4bdb-adbc-10dac8eb9544 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:01.011881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b58bb059-3689-4bdb-adbc-10dac8eb9544 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:01.012340 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b58bb059-3689-4bdb-adbc-10dac8eb9544 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:01.012757 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b58bb059-3689-4bdb-adbc-10dac8eb9544 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:01.265159 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-b58bb059-3689-4bdb-adbc-10dac8eb9544 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:01.273210 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-b58bb059-3689-4bdb-adbc-10dac8eb9544 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:01.274741 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-b58bb059-3689-4bdb-adbc-10dac8eb9544 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:01.275905 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-b58bb059-3689-4bdb-adbc-10dac8eb9544 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1406 microversion: 2.20 time: 0.277568 Oct 24 13:17:01.276467 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 311/637] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:17:00 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1406 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:17:01.622650 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-267f3705-b976-4868-b271-4ae8ff6e62d9 req-6f9ecd7c-8f41-48b1-971e-2b491b152e06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54a71380-34c3-40b5-a376-1622f1e44528", "tag": "486a8286-8bd4-4826-a629-5c1b4c9df0e1"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:17:01.632433 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-267f3705-b976-4868-b271-4ae8ff6e62d9 req-6f9ecd7c-8f41-48b1-971e-2b491b152e06 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:01.633287 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-267f3705-b976-4868-b271-4ae8ff6e62d9 req-6f9ecd7c-8f41-48b1-971e-2b491b152e06 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:01.633718 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-267f3705-b976-4868-b271-4ae8ff6e62d9 req-6f9ecd7c-8f41-48b1-971e-2b491b152e06 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:01.644292 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-267f3705-b976-4868-b271-4ae8ff6e62d9 req-6f9ecd7c-8f41-48b1-971e-2b491b152e06 service nova] Creating event network-changed:486a8286-8bd4-4826-a629-5c1b4c9df0e1 for instance 54a71380-34c3-40b5-a376-1622f1e44528 on hv-cinder-86248 Oct 24 13:17:01.649810 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-267f3705-b976-4868-b271-4ae8ff6e62d9 req-6f9ecd7c-8f41-48b1-971e-2b491b152e06 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030756 Oct 24 13:17:01.650370 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 327/638] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:17:01.725686 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-e163b997-4378-40b6-b34a-98cf6f68991f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:01.726478 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-e163b997-4378-40b6-b34a-98cf6f68991f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] [instance: 464765b9-dece-4c4b-b84b-9361ad82ac88] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:01.732777 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e163b997-4378-40b6-b34a-98cf6f68991f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:01.733267 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e163b997-4378-40b6-b34a-98cf6f68991f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:01.733701 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e163b997-4378-40b6-b34a-98cf6f68991f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:01.734399 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e163b997-4378-40b6-b34a-98cf6f68991f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:01.734853 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e163b997-4378-40b6-b34a-98cf6f68991f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:01.735302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e163b997-4378-40b6-b34a-98cf6f68991f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:01.749254 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-e163b997-4378-40b6-b34a-98cf6f68991f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] HTTP exception thrown: Instance 464765b9-dece-4c4b-b84b-9361ad82ac88 could not be found. Oct 24 13:17:01.750765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-e163b997-4378-40b6-b34a-98cf6f68991f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Request method failure captured: Oct 24 13:17:01.750765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88 HTTP/1.1 Oct 24 13:17:01.750765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:17:01.750765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:17:01.750765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:17:01.750765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:17:01.750765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:17:01.750765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:17:01.750765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:17:01.750765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:17:01.750765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo-ytXsiU5jwHHSxQ-38u7BeXV-E4Ea-rbYzHBeFO5VD4oPVNkG2N-o7Z5QCkfFsOaVBMQrlFMchgdgrh_TuCZVIMXNdn1tSyB7hCI5horlIQG6SIsvwnmHQC-p0TH7alpf2BpG1k6zdTxXRsd-T5weTZ09dsqFAuADqgUB9b5A_fiw Oct 24 13:17:01.750765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:17:01.750765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:17:01.750765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:17:01.750765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:17:01.750765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:17:01.750765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:17:01.750765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: f027aba5a38b422fbc30d64b9ee2ef79 Oct 24 13:17:01.750765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1800166311 Oct 24 13:17:01.750765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:17:01.750765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:17:01.752317 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f027aba5a38b422fbc30d64b9ee2ef79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f027aba5a38b422fbc30d64b9ee2ef79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f027aba5a38b422fbc30d64b9ee2ef79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f027aba5a38b422fbc30d64b9ee2ef79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:17:01.752317 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-VolumesSnapshotTestJSON-1800166311 Oct 24 13:17:01.752317 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: f027aba5a38b422fbc30d64b9ee2ef79 Oct 24 13:17:01.752317 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1800166311 Oct 24 13:17:01.752317 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-VolumesSnapshotTestJSON-1800166311-project Oct 24 13:17:01.752317 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:17:01.752317 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:17:01.752317 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: abd7bde497c14d25a06c276609aa143f Oct 24 13:17:01.752317 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-VolumesSnapshotTestJSON-1800166311-project Oct 24 13:17:01.752317 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:17:01.752317 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Instance 464765b9-dece-4c4b-b84b-9361ad82ac88 could not be found. Oct 24 13:17:01.752317 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': '464765b9-dece-4c4b-b84b-9361ad82ac88'} Oct 24 13:17:01.753163 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:17:01.753163 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:17:01.753163 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:17:01.753163 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:17:01.753163 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:17:01.753163 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:17:01.753163 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:17:01.753163 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:17:01.753163 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:17:01.753163 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:17:01.753163 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 464765b9-dece-4c4b-b84b-9361ad82ac88 could not be found. Oct 24 13:17:01.753163 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:17:01.753163 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:17:01.753163 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:17:01.753163 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:17:01.753163 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:17:01.753163 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:17:01.753163 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:17:01.753163 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:17:01.753163 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:17:01.754464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:17:01.754464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:17:01.754464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:17:01.754464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:17:01.754464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:17:01.754464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:17:01.754464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:17:01.754464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 464765b9-dece-4c4b-b84b-9361ad82ac88 could not be found. Oct 24 13:17:01.754464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:17:01.754464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:17:01.754464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:17:01.754464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:17:01.754464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:17:01.754464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:17:01.754464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:17:01.754464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:17:01.754464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 464765b9-dece-4c4b-b84b-9361ad82ac88 could not be found. Oct 24 13:17:01.754464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:17:01.755647 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-e163b997-4378-40b6-b34a-98cf6f68991f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] Returning 404 to user: Instance 464765b9-dece-4c4b-b84b-9361ad82ac88 could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:17:01.755647 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-e163b997-4378-40b6-b34a-98cf6f68991f tempest-VolumesSnapshotTestJSON-1800166311 tempest-VolumesSnapshotTestJSON-1800166311-project] 10.222.0.42 "GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88" status: 404 len: 111 microversion: 2.1 time: 0.030379 Oct 24 13:17:01.755647 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 312/639] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:01 2022] GET /compute/v2.1/servers/464765b9-dece-4c4b-b84b-9361ad82ac88 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:17:02.302409 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-f382652f-00b7-4dfa-aca9-7c40a33f6d95 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:02.303018 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-f382652f-00b7-4dfa-aca9-7c40a33f6d95 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:02.309385 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f382652f-00b7-4dfa-aca9-7c40a33f6d95 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:02.309867 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f382652f-00b7-4dfa-aca9-7c40a33f6d95 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:02.310306 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f382652f-00b7-4dfa-aca9-7c40a33f6d95 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:02.311019 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f382652f-00b7-4dfa-aca9-7c40a33f6d95 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:02.311517 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f382652f-00b7-4dfa-aca9-7c40a33f6d95 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:02.311914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f382652f-00b7-4dfa-aca9-7c40a33f6d95 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:02.445929 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-f382652f-00b7-4dfa-aca9-7c40a33f6d95 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:02.454319 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-f382652f-00b7-4dfa-aca9-7c40a33f6d95 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:02.455787 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-f382652f-00b7-4dfa-aca9-7c40a33f6d95 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:02.456904 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-f382652f-00b7-4dfa-aca9-7c40a33f6d95 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1406 microversion: 2.20 time: 0.158898 Oct 24 13:17:02.457459 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 328/640] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:17:02 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:17:03.482310 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-a30ca6fe-e2cd-4983-b489-77eb5d156ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:03.482928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-a30ca6fe-e2cd-4983-b489-77eb5d156ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:03.489355 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a30ca6fe-e2cd-4983-b489-77eb5d156ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:03.489839 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a30ca6fe-e2cd-4983-b489-77eb5d156ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:03.490270 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a30ca6fe-e2cd-4983-b489-77eb5d156ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:03.490962 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a30ca6fe-e2cd-4983-b489-77eb5d156ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:03.491443 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a30ca6fe-e2cd-4983-b489-77eb5d156ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:03.492478 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a30ca6fe-e2cd-4983-b489-77eb5d156ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:03.653252 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-a30ca6fe-e2cd-4983-b489-77eb5d156ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:03.661623 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-a30ca6fe-e2cd-4983-b489-77eb5d156ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:03.663080 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-a30ca6fe-e2cd-4983-b489-77eb5d156ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:03.664342 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-a30ca6fe-e2cd-4983-b489-77eb5d156ee1 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1406 microversion: 2.20 time: 0.185929 Oct 24 13:17:03.664892 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 313/641] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:17:03 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:17:04.689805 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-ba48d27a-c9e2-4db6-b5f4-4fbf9cb27fc5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:04.690459 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-ba48d27a-c9e2-4db6-b5f4-4fbf9cb27fc5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:04.698358 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ba48d27a-c9e2-4db6-b5f4-4fbf9cb27fc5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:04.698762 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ba48d27a-c9e2-4db6-b5f4-4fbf9cb27fc5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:04.699356 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ba48d27a-c9e2-4db6-b5f4-4fbf9cb27fc5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:04.700111 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ba48d27a-c9e2-4db6-b5f4-4fbf9cb27fc5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:04.700646 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ba48d27a-c9e2-4db6-b5f4-4fbf9cb27fc5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:04.701157 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ba48d27a-c9e2-4db6-b5f4-4fbf9cb27fc5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:04.831975 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-ba48d27a-c9e2-4db6-b5f4-4fbf9cb27fc5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:04.840093 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-ba48d27a-c9e2-4db6-b5f4-4fbf9cb27fc5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:04.841533 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-ba48d27a-c9e2-4db6-b5f4-4fbf9cb27fc5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:04.842632 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-ba48d27a-c9e2-4db6-b5f4-4fbf9cb27fc5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1406 microversion: 2.20 time: 0.156711 Oct 24 13:17:04.843219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 329/642] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:17:04 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:17:05.867088 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9d331de3-2ff0-4be7-a7df-4bdb9c63dbb7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:05.867674 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9d331de3-2ff0-4be7-a7df-4bdb9c63dbb7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:05.874005 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9d331de3-2ff0-4be7-a7df-4bdb9c63dbb7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:05.874478 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9d331de3-2ff0-4be7-a7df-4bdb9c63dbb7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:05.874908 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9d331de3-2ff0-4be7-a7df-4bdb9c63dbb7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:05.875607 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9d331de3-2ff0-4be7-a7df-4bdb9c63dbb7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:05.876051 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9d331de3-2ff0-4be7-a7df-4bdb9c63dbb7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:05.876463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9d331de3-2ff0-4be7-a7df-4bdb9c63dbb7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:06.008753 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-9d331de3-2ff0-4be7-a7df-4bdb9c63dbb7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:06.016914 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-9d331de3-2ff0-4be7-a7df-4bdb9c63dbb7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:06.018369 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-9d331de3-2ff0-4be7-a7df-4bdb9c63dbb7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:06.019502 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-9d331de3-2ff0-4be7-a7df-4bdb9c63dbb7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1406 microversion: 2.20 time: 0.156298 Oct 24 13:17:06.020052 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 314/643] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:17:05 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:17:07.044277 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-4c37a294-c50a-41c0-8b81-59a30addae5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:07.044806 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-4c37a294-c50a-41c0-8b81-59a30addae5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:07.051241 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4c37a294-c50a-41c0-8b81-59a30addae5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:07.051715 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4c37a294-c50a-41c0-8b81-59a30addae5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:07.052147 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4c37a294-c50a-41c0-8b81-59a30addae5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:07.052828 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4c37a294-c50a-41c0-8b81-59a30addae5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:07.053277 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4c37a294-c50a-41c0-8b81-59a30addae5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:07.053693 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4c37a294-c50a-41c0-8b81-59a30addae5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:07.189955 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-4c37a294-c50a-41c0-8b81-59a30addae5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:07.198962 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-4c37a294-c50a-41c0-8b81-59a30addae5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:07.200419 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-4c37a294-c50a-41c0-8b81-59a30addae5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:07.201509 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-4c37a294-c50a-41c0-8b81-59a30addae5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1406 microversion: 2.20 time: 0.161232 Oct 24 13:17:07.202062 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 330/644] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:17:07 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:17:07.638106 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-0a066af9-cf8f-4060-b999-73c0c5d9fba5 req-697253a1-3b2c-4d56-a3c1-306f8cd0ec0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54a71380-34c3-40b5-a376-1622f1e44528", "name": "network-vif-plugged", "status": "completed", "tag": "486a8286-8bd4-4826-a629-5c1b4c9df0e1"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:17:07.644032 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=2 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:07.644734 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=10 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:07.653129 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-0a066af9-cf8f-4060-b999-73c0c5d9fba5 req-697253a1-3b2c-4d56-a3c1-306f8cd0ec0e service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:07.653613 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-0a066af9-cf8f-4060-b999-73c0c5d9fba5 req-697253a1-3b2c-4d56-a3c1-306f8cd0ec0e service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:07.654044 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-0a066af9-cf8f-4060-b999-73c0c5d9fba5 req-697253a1-3b2c-4d56-a3c1-306f8cd0ec0e service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:07.665394 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-0a066af9-cf8f-4060-b999-73c0c5d9fba5 req-697253a1-3b2c-4d56-a3c1-306f8cd0ec0e service nova] Creating event network-vif-plugged:486a8286-8bd4-4826-a629-5c1b4c9df0e1 for instance 54a71380-34c3-40b5-a376-1622f1e44528 on hv-cinder-86248 Oct 24 13:17:07.670456 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-0a066af9-cf8f-4060-b999-73c0c5d9fba5 req-697253a1-3b2c-4d56-a3c1-306f8cd0ec0e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036237 Oct 24 13:17:07.670912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 315/645] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:17:08.227211 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-f0cb10d1-25ec-47ca-8fa2-4f50d2010c79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:08.227823 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-f0cb10d1-25ec-47ca-8fa2-4f50d2010c79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:08.229825 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=2 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:08.236211 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f0cb10d1-25ec-47ca-8fa2-4f50d2010c79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:08.236710 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f0cb10d1-25ec-47ca-8fa2-4f50d2010c79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:08.237126 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f0cb10d1-25ec-47ca-8fa2-4f50d2010c79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:08.237820 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f0cb10d1-25ec-47ca-8fa2-4f50d2010c79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:08.238273 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f0cb10d1-25ec-47ca-8fa2-4f50d2010c79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:08.238692 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f0cb10d1-25ec-47ca-8fa2-4f50d2010c79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:08.365955 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-f0cb10d1-25ec-47ca-8fa2-4f50d2010c79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:08.374234 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-f0cb10d1-25ec-47ca-8fa2-4f50d2010c79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:08.375672 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-f0cb10d1-25ec-47ca-8fa2-4f50d2010c79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:08.375910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-c2e13482-eafd-483a-b164-b2417aa2913e tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:17:08.376768 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-f0cb10d1-25ec-47ca-8fa2-4f50d2010c79 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1406 microversion: 2.20 time: 0.154301 Oct 24 13:17:08.377318 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 331/646] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:17:08 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:17:08.378219 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-c2e13482-eafd-483a-b164-b2417aa2913e tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:08.384757 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c2e13482-eafd-483a-b164-b2417aa2913e tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:08.385271 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c2e13482-eafd-483a-b164-b2417aa2913e tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:08.385991 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c2e13482-eafd-483a-b164-b2417aa2913e tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:08.386792 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c2e13482-eafd-483a-b164-b2417aa2913e tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:08.387341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c2e13482-eafd-483a-b164-b2417aa2913e tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:08.387773 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c2e13482-eafd-483a-b164-b2417aa2913e tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:08.461123 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-c2e13482-eafd-483a-b164-b2417aa2913e tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "POST /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4/action" status: 202 len: 0 microversion: 2.1 time: 0.089147 Oct 24 13:17:08.461899 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 316/647] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 24 13:17:08 2022] POST /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 24 13:17:08.469980 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-5f655e9c-cbb2-4b82-a239-6dd04d83c871 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:08.470588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-5f655e9c-cbb2-4b82-a239-6dd04d83c871 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:08.476592 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5f655e9c-cbb2-4b82-a239-6dd04d83c871 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:08.477073 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5f655e9c-cbb2-4b82-a239-6dd04d83c871 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:08.477504 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5f655e9c-cbb2-4b82-a239-6dd04d83c871 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:08.478192 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5f655e9c-cbb2-4b82-a239-6dd04d83c871 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:08.478644 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5f655e9c-cbb2-4b82-a239-6dd04d83c871 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:08.479091 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5f655e9c-cbb2-4b82-a239-6dd04d83c871 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:08.622344 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-5f655e9c-cbb2-4b82-a239-6dd04d83c871 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:08.630692 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-5f655e9c-cbb2-4b82-a239-6dd04d83c871 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1749 microversion: 2.1 time: 0.164586 Oct 24 13:17:08.631309 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 332/648] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:08 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:09.403224 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-fff3e481-77ac-46cb-a897-4fa40cdb516c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:09.404670 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-fff3e481-77ac-46cb-a897-4fa40cdb516c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:09.411072 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fff3e481-77ac-46cb-a897-4fa40cdb516c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:09.411564 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fff3e481-77ac-46cb-a897-4fa40cdb516c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:09.412028 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fff3e481-77ac-46cb-a897-4fa40cdb516c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:09.412721 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fff3e481-77ac-46cb-a897-4fa40cdb516c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:09.413371 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fff3e481-77ac-46cb-a897-4fa40cdb516c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:09.413606 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fff3e481-77ac-46cb-a897-4fa40cdb516c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:09.546053 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-fff3e481-77ac-46cb-a897-4fa40cdb516c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:09.554462 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-fff3e481-77ac-46cb-a897-4fa40cdb516c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:09.555873 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-fff3e481-77ac-46cb-a897-4fa40cdb516c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:09.556980 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-fff3e481-77ac-46cb-a897-4fa40cdb516c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1406 microversion: 2.20 time: 0.159472 Oct 24 13:17:09.557536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 317/649] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:17:09 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:17:09.654958 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-ca2e9d2e-ea1a-4341-97ef-dfb6606d4573 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:09.655610 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-ca2e9d2e-ea1a-4341-97ef-dfb6606d4573 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:09.662030 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ca2e9d2e-ea1a-4341-97ef-dfb6606d4573 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:09.662500 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ca2e9d2e-ea1a-4341-97ef-dfb6606d4573 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:09.662930 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ca2e9d2e-ea1a-4341-97ef-dfb6606d4573 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:09.663933 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ca2e9d2e-ea1a-4341-97ef-dfb6606d4573 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:09.664391 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ca2e9d2e-ea1a-4341-97ef-dfb6606d4573 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:09.664814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ca2e9d2e-ea1a-4341-97ef-dfb6606d4573 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:09.811769 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-ca2e9d2e-ea1a-4341-97ef-dfb6606d4573 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:09.821100 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-ca2e9d2e-ea1a-4341-97ef-dfb6606d4573 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1749 microversion: 2.1 time: 0.168862 Oct 24 13:17:09.821673 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 333/650] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:09 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1749 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:10.581766 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-7ca7268b-ef9d-4cce-92be-6f58e1fcba3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:10.582376 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-7ca7268b-ef9d-4cce-92be-6f58e1fcba3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:10.584856 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:10.590900 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7ca7268b-ef9d-4cce-92be-6f58e1fcba3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:10.591416 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7ca7268b-ef9d-4cce-92be-6f58e1fcba3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:10.591848 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7ca7268b-ef9d-4cce-92be-6f58e1fcba3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:10.592540 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7ca7268b-ef9d-4cce-92be-6f58e1fcba3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:10.592990 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7ca7268b-ef9d-4cce-92be-6f58e1fcba3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:10.593421 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7ca7268b-ef9d-4cce-92be-6f58e1fcba3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:10.723366 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-7ca7268b-ef9d-4cce-92be-6f58e1fcba3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:10.731753 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-7ca7268b-ef9d-4cce-92be-6f58e1fcba3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:10.733190 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-7ca7268b-ef9d-4cce-92be-6f58e1fcba3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:10.734337 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-7ca7268b-ef9d-4cce-92be-6f58e1fcba3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1598 microversion: 2.20 time: 0.156544 Oct 24 13:17:10.734893 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 318/651] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:17:10 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:17:10.759127 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-13120081-56ab-4b62-9d59-9ad578b547b9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:10.759678 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-13120081-56ab-4b62-9d59-9ad578b547b9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:10.766220 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-13120081-56ab-4b62-9d59-9ad578b547b9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:10.766718 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-13120081-56ab-4b62-9d59-9ad578b547b9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:10.767209 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-13120081-56ab-4b62-9d59-9ad578b547b9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:10.767899 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-13120081-56ab-4b62-9d59-9ad578b547b9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:10.768353 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-13120081-56ab-4b62-9d59-9ad578b547b9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:10.768804 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-13120081-56ab-4b62-9d59-9ad578b547b9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:10.844561 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-1159ce58-4242-48c9-b3a4-3c557607c151 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:10.845174 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-1159ce58-4242-48c9-b3a4-3c557607c151 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:10.847388 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-13120081-56ab-4b62-9d59-9ad578b547b9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092300 Oct 24 13:17:10.848096 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 334/652] 10.222.0.42 () {60 vars in 1316 bytes} [Mon Oct 24 13:17:10 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:17:10.851514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1159ce58-4242-48c9-b3a4-3c557607c151 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:10.851918 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1159ce58-4242-48c9-b3a4-3c557607c151 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:10.852354 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1159ce58-4242-48c9-b3a4-3c557607c151 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:10.853047 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1159ce58-4242-48c9-b3a4-3c557607c151 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:10.853495 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1159ce58-4242-48c9-b3a4-3c557607c151 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:10.853942 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1159ce58-4242-48c9-b3a4-3c557607c151 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:11.139748 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-1159ce58-4242-48c9-b3a4-3c557607c151 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:11.149064 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-1159ce58-4242-48c9-b3a4-3c557607c151 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1754 microversion: 2.1 time: 0.307077 Oct 24 13:17:11.149822 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 319/653] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:10 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1754 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:17:12.106686 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-172a464c-bc32-4deb-94f6-2cee3abdd3f5 req-ea2ad370-bfb7-4f44-9379-f561fb9ec3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54a71380-34c3-40b5-a376-1622f1e44528", "tag": "486a8286-8bd4-4826-a629-5c1b4c9df0e1"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:17:12.116022 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-172a464c-bc32-4deb-94f6-2cee3abdd3f5 req-ea2ad370-bfb7-4f44-9379-f561fb9ec3e1 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:12.117602 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-172a464c-bc32-4deb-94f6-2cee3abdd3f5 req-ea2ad370-bfb7-4f44-9379-f561fb9ec3e1 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:12.118036 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-172a464c-bc32-4deb-94f6-2cee3abdd3f5 req-ea2ad370-bfb7-4f44-9379-f561fb9ec3e1 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:12.129304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-172a464c-bc32-4deb-94f6-2cee3abdd3f5 req-ea2ad370-bfb7-4f44-9379-f561fb9ec3e1 service nova] Creating event network-changed:486a8286-8bd4-4826-a629-5c1b4c9df0e1 for instance 54a71380-34c3-40b5-a376-1622f1e44528 on hv-cinder-86248 Oct 24 13:17:12.136365 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-172a464c-bc32-4deb-94f6-2cee3abdd3f5 req-ea2ad370-bfb7-4f44-9379-f561fb9ec3e1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033958 Oct 24 13:17:12.137059 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 335/654] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:17:12.171988 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9667a0e9-2d92-4c43-b8bb-2027bc352e0d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:12.172729 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9667a0e9-2d92-4c43-b8bb-2027bc352e0d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:12.179845 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9667a0e9-2d92-4c43-b8bb-2027bc352e0d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:12.180397 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9667a0e9-2d92-4c43-b8bb-2027bc352e0d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:12.180835 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9667a0e9-2d92-4c43-b8bb-2027bc352e0d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:12.181526 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9667a0e9-2d92-4c43-b8bb-2027bc352e0d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:12.181982 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9667a0e9-2d92-4c43-b8bb-2027bc352e0d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:12.182399 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9667a0e9-2d92-4c43-b8bb-2027bc352e0d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:12.332241 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-9667a0e9-2d92-4c43-b8bb-2027bc352e0d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:12.340645 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-9667a0e9-2d92-4c43-b8bb-2027bc352e0d tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1754 microversion: 2.1 time: 0.172535 Oct 24 13:17:12.341222 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 320/655] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:12 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:13.367204 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-f91d58a8-931c-44bc-b601-ea62de41c450 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:13.367977 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-f91d58a8-931c-44bc-b601-ea62de41c450 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:13.374215 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f91d58a8-931c-44bc-b601-ea62de41c450 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:13.374705 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f91d58a8-931c-44bc-b601-ea62de41c450 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:13.375172 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f91d58a8-931c-44bc-b601-ea62de41c450 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:13.375861 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f91d58a8-931c-44bc-b601-ea62de41c450 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:13.376320 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f91d58a8-931c-44bc-b601-ea62de41c450 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:13.376745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f91d58a8-931c-44bc-b601-ea62de41c450 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:13.527562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-f91d58a8-931c-44bc-b601-ea62de41c450 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:13.535749 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-f91d58a8-931c-44bc-b601-ea62de41c450 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1754 microversion: 2.1 time: 0.173846 Oct 24 13:17:13.536319 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 336/656] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:13 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:14.559139 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-81f926e3-42d1-4fb7-ab8d-51c9862444ee tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:14.559826 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-81f926e3-42d1-4fb7-ab8d-51c9862444ee tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:14.566046 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-81f926e3-42d1-4fb7-ab8d-51c9862444ee tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:14.566526 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-81f926e3-42d1-4fb7-ab8d-51c9862444ee tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:14.566941 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-81f926e3-42d1-4fb7-ab8d-51c9862444ee tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:14.567696 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-81f926e3-42d1-4fb7-ab8d-51c9862444ee tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:14.568153 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-81f926e3-42d1-4fb7-ab8d-51c9862444ee tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:14.568576 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-81f926e3-42d1-4fb7-ab8d-51c9862444ee tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:14.573105 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:14.727926 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-81f926e3-42d1-4fb7-ab8d-51c9862444ee tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:14.736613 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-81f926e3-42d1-4fb7-ab8d-51c9862444ee tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1754 microversion: 2.1 time: 0.181321 Oct 24 13:17:14.737166 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 321/657] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:14 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1754 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:15.761914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-8925b587-a4c5-49b1-a60d-371999e98d1f tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:15.762441 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-8925b587-a4c5-49b1-a60d-371999e98d1f tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:15.768442 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8925b587-a4c5-49b1-a60d-371999e98d1f tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:15.768924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8925b587-a4c5-49b1-a60d-371999e98d1f tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:15.769358 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8925b587-a4c5-49b1-a60d-371999e98d1f tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:15.770048 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8925b587-a4c5-49b1-a60d-371999e98d1f tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:15.770496 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8925b587-a4c5-49b1-a60d-371999e98d1f tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:15.770919 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8925b587-a4c5-49b1-a60d-371999e98d1f tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:15.924958 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-8925b587-a4c5-49b1-a60d-371999e98d1f tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:15.928457 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:15.935209 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-8925b587-a4c5-49b1-a60d-371999e98d1f tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1754 microversion: 2.1 time: 0.177909 Oct 24 13:17:15.935794 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 337/658] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:15 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:16.960689 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-a757f040-462f-4cba-b1e5-0ccdec66f1cf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:16.961295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-a757f040-462f-4cba-b1e5-0ccdec66f1cf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:16.967674 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a757f040-462f-4cba-b1e5-0ccdec66f1cf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:16.968150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a757f040-462f-4cba-b1e5-0ccdec66f1cf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:16.968580 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a757f040-462f-4cba-b1e5-0ccdec66f1cf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:16.969261 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a757f040-462f-4cba-b1e5-0ccdec66f1cf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:16.969712 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a757f040-462f-4cba-b1e5-0ccdec66f1cf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:16.970131 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a757f040-462f-4cba-b1e5-0ccdec66f1cf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:17.112253 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-a757f040-462f-4cba-b1e5-0ccdec66f1cf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:17.120614 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-a757f040-462f-4cba-b1e5-0ccdec66f1cf tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1754 microversion: 2.1 time: 0.164149 Oct 24 13:17:17.121172 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 322/659] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:16 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:18.145622 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c678f5eb-41a4-4457-8ec3-a2b3d826d98a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:18.146260 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-c678f5eb-41a4-4457-8ec3-a2b3d826d98a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:18.155025 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c678f5eb-41a4-4457-8ec3-a2b3d826d98a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:18.155530 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c678f5eb-41a4-4457-8ec3-a2b3d826d98a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:18.155971 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c678f5eb-41a4-4457-8ec3-a2b3d826d98a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:18.156668 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c678f5eb-41a4-4457-8ec3-a2b3d826d98a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:18.157115 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c678f5eb-41a4-4457-8ec3-a2b3d826d98a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:18.157534 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c678f5eb-41a4-4457-8ec3-a2b3d826d98a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:18.298763 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-c678f5eb-41a4-4457-8ec3-a2b3d826d98a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:18.307495 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-c678f5eb-41a4-4457-8ec3-a2b3d826d98a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1754 microversion: 2.1 time: 0.165720 Oct 24 13:17:18.308271 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 338/660] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:18 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:19.331566 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-abf40d99-5065-4430-8e3e-6d350009e536 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:19.332109 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-abf40d99-5065-4430-8e3e-6d350009e536 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:19.338729 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-abf40d99-5065-4430-8e3e-6d350009e536 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:19.339254 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-abf40d99-5065-4430-8e3e-6d350009e536 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:19.339702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-abf40d99-5065-4430-8e3e-6d350009e536 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:19.340372 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-abf40d99-5065-4430-8e3e-6d350009e536 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:19.340823 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-abf40d99-5065-4430-8e3e-6d350009e536 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:19.341241 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-abf40d99-5065-4430-8e3e-6d350009e536 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:19.493695 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-abf40d99-5065-4430-8e3e-6d350009e536 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:19.502149 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-abf40d99-5065-4430-8e3e-6d350009e536 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1754 microversion: 2.1 time: 0.174488 Oct 24 13:17:19.502720 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 323/661] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:19 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:20.526271 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-8d649652-2a0d-4aad-96be-a34f929b0c43 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:20.526875 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-8d649652-2a0d-4aad-96be-a34f929b0c43 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:20.533375 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8d649652-2a0d-4aad-96be-a34f929b0c43 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:20.533847 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8d649652-2a0d-4aad-96be-a34f929b0c43 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:20.534275 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8d649652-2a0d-4aad-96be-a34f929b0c43 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:20.534949 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8d649652-2a0d-4aad-96be-a34f929b0c43 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:20.535420 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8d649652-2a0d-4aad-96be-a34f929b0c43 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:20.535838 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8d649652-2a0d-4aad-96be-a34f929b0c43 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:20.799712 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-8d649652-2a0d-4aad-96be-a34f929b0c43 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:20.808628 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-8d649652-2a0d-4aad-96be-a34f929b0c43 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1754 microversion: 2.1 time: 0.286695 Oct 24 13:17:20.809202 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 339/662] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:20 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1754 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:21.832719 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-470d5f50-1b6d-4f16-9b05-0dd8d919539a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:21.833397 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-470d5f50-1b6d-4f16-9b05-0dd8d919539a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:21.840135 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-470d5f50-1b6d-4f16-9b05-0dd8d919539a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:21.840596 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-470d5f50-1b6d-4f16-9b05-0dd8d919539a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:21.841026 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-470d5f50-1b6d-4f16-9b05-0dd8d919539a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:21.841704 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-470d5f50-1b6d-4f16-9b05-0dd8d919539a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:21.842151 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-470d5f50-1b6d-4f16-9b05-0dd8d919539a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:21.842569 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-470d5f50-1b6d-4f16-9b05-0dd8d919539a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:22.043685 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-470d5f50-1b6d-4f16-9b05-0dd8d919539a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:22.051757 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-470d5f50-1b6d-4f16-9b05-0dd8d919539a tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1757 microversion: 2.1 time: 0.223150 Oct 24 13:17:22.052313 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 324/663] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:21 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1757 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:29.363822 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-44f2f97d-811a-47e4-b11e-46ce3a459730 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:29.364327 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-44f2f97d-811a-47e4-b11e-46ce3a459730 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:29.370840 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-44f2f97d-811a-47e4-b11e-46ce3a459730 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:29.371362 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-44f2f97d-811a-47e4-b11e-46ce3a459730 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:29.371776 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-44f2f97d-811a-47e4-b11e-46ce3a459730 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:29.372457 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-44f2f97d-811a-47e4-b11e-46ce3a459730 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:29.372933 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-44f2f97d-811a-47e4-b11e-46ce3a459730 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:29.373354 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-44f2f97d-811a-47e4-b11e-46ce3a459730 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:29.396127 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-44f2f97d-811a-47e4-b11e-46ce3a459730 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5/ips" status: 200 len: 149 microversion: 2.1 time: 0.036307 Oct 24 13:17:29.396683 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 340/664] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Oct 24 13:17:29 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:17:30.729051 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-088e6a6a-9352-427c-9082-21b5f9b1becf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2b64738-b06d-4b87-b48a-247387d92923"}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:17:30.731490 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-088e6a6a-9352-427c-9082-21b5f9b1becf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:30.737912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-088e6a6a-9352-427c-9082-21b5f9b1becf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:30.738386 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-088e6a6a-9352-427c-9082-21b5f9b1becf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:30.738816 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-088e6a6a-9352-427c-9082-21b5f9b1becf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:30.739535 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-088e6a6a-9352-427c-9082-21b5f9b1becf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:30.739983 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-088e6a6a-9352-427c-9082-21b5f9b1becf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:30.740399 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-088e6a6a-9352-427c-9082-21b5f9b1becf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:31.085476 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-088e6a6a-9352-427c-9082-21b5f9b1becf tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "POST /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.360518 Oct 24 13:17:31.085942 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 325/665] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 24 13:17:30 2022] POST /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5/os-volume_attachments => generated 194 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:17:31.246670 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-7ffbbaf4-f9eb-4d81-9d98-e804ca421b62 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:31.247219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-7ffbbaf4-f9eb-4d81-9d98-e804ca421b62 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:31.251142 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=34 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:31.255790 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7ffbbaf4-f9eb-4d81-9d98-e804ca421b62 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:31.256278 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7ffbbaf4-f9eb-4d81-9d98-e804ca421b62 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:31.256827 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7ffbbaf4-f9eb-4d81-9d98-e804ca421b62 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:31.257507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7ffbbaf4-f9eb-4d81-9d98-e804ca421b62 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:31.257961 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7ffbbaf4-f9eb-4d81-9d98-e804ca421b62 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:31.258520 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7ffbbaf4-f9eb-4d81-9d98-e804ca421b62 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:31.340645 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.objects.instance [None req-7ffbbaf4-f9eb-4d81-9d98-e804ca421b62 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lazy-loading 'services' on Instance uuid 6bd238e2-4223-465c-8028-c291fe1db874 {{(pid=118914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:17:31.411382 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-7ffbbaf4-f9eb-4d81-9d98-e804ca421b62 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-volume_attachments/96a50e5f-05ec-43df-b264-7e33f54801bc" status: 202 len: 0 microversion: 2.1 time: 0.168837 Oct 24 13:17:31.411986 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 341/666] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 24 13:17:31 2022] DELETE /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-volume_attachments/96a50e5f-05ec-43df-b264-7e33f54801bc => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:17:31.421748 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-d0af0c02-0710-4bb6-b6f4-d4d9a29d652b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:31.424118 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-d0af0c02-0710-4bb6-b6f4-d4d9a29d652b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:31.431490 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d0af0c02-0710-4bb6-b6f4-d4d9a29d652b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:31.431991 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d0af0c02-0710-4bb6-b6f4-d4d9a29d652b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:31.432426 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d0af0c02-0710-4bb6-b6f4-d4d9a29d652b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:31.433117 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d0af0c02-0710-4bb6-b6f4-d4d9a29d652b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:31.433574 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d0af0c02-0710-4bb6-b6f4-d4d9a29d652b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:31.434096 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d0af0c02-0710-4bb6-b6f4-d4d9a29d652b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:31.464051 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-d0af0c02-0710-4bb6-b6f4-d4d9a29d652b tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046988 Oct 24 13:17:31.464599 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 326/667] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:17:31 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:17:32.701287 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-6635b888-cb1f-4f9b-acdc-d6705d85d420 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:32.703801 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-6635b888-cb1f-4f9b-acdc-d6705d85d420 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:32.710619 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6635b888-cb1f-4f9b-acdc-d6705d85d420 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:32.711128 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6635b888-cb1f-4f9b-acdc-d6705d85d420 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:32.711572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6635b888-cb1f-4f9b-acdc-d6705d85d420 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:32.712273 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6635b888-cb1f-4f9b-acdc-d6705d85d420 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:32.712734 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6635b888-cb1f-4f9b-acdc-d6705d85d420 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:32.713159 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6635b888-cb1f-4f9b-acdc-d6705d85d420 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:32.742137 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-6635b888-cb1f-4f9b-acdc-d6705d85d420 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.269134 Oct 24 13:17:32.742613 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 342/668] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:17:32 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-volume_attachments => generated 197 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:17:33.754518 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-cdd39fed-b348-4f1f-9469-3307c9a3cccb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:33.756903 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-cdd39fed-b348-4f1f-9469-3307c9a3cccb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:33.763688 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-cdd39fed-b348-4f1f-9469-3307c9a3cccb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:33.764169 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-cdd39fed-b348-4f1f-9469-3307c9a3cccb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:33.764606 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-cdd39fed-b348-4f1f-9469-3307c9a3cccb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:33.765291 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-cdd39fed-b348-4f1f-9469-3307c9a3cccb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:33.765745 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-cdd39fed-b348-4f1f-9469-3307c9a3cccb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:33.766164 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-cdd39fed-b348-4f1f-9469-3307c9a3cccb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:33.796867 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-cdd39fed-b348-4f1f-9469-3307c9a3cccb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046129 Oct 24 13:17:33.797433 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 327/669] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:17:33 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:17:34.809759 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-91049e0b-7a06-4067-a039-c8d58a233282 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:34.811907 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-91049e0b-7a06-4067-a039-c8d58a233282 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:34.818196 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-91049e0b-7a06-4067-a039-c8d58a233282 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:34.818821 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-91049e0b-7a06-4067-a039-c8d58a233282 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:34.820269 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-91049e0b-7a06-4067-a039-c8d58a233282 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:34.820950 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-91049e0b-7a06-4067-a039-c8d58a233282 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:34.821403 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-91049e0b-7a06-4067-a039-c8d58a233282 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:34.821823 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-91049e0b-7a06-4067-a039-c8d58a233282 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:34.851549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-91049e0b-7a06-4067-a039-c8d58a233282 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045661 Oct 24 13:17:34.852090 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 343/670] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:17:34 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:17:35.863863 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-c22437dc-bc0d-46e9-92e5-19414294c0cb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:35.866512 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-c22437dc-bc0d-46e9-92e5-19414294c0cb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:35.872863 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c22437dc-bc0d-46e9-92e5-19414294c0cb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:35.873337 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c22437dc-bc0d-46e9-92e5-19414294c0cb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:35.873768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c22437dc-bc0d-46e9-92e5-19414294c0cb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:35.874445 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c22437dc-bc0d-46e9-92e5-19414294c0cb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:35.874894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c22437dc-bc0d-46e9-92e5-19414294c0cb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:35.875346 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c22437dc-bc0d-46e9-92e5-19414294c0cb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:35.906352 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-c22437dc-bc0d-46e9-92e5-19414294c0cb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046393 Oct 24 13:17:35.906900 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 328/671] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:17:35 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:17:36.918823 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-af622626-fd18-4733-8d31-048eb5322308 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:36.920972 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-af622626-fd18-4733-8d31-048eb5322308 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:36.927687 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-af622626-fd18-4733-8d31-048eb5322308 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:36.929169 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-af622626-fd18-4733-8d31-048eb5322308 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:36.929609 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-af622626-fd18-4733-8d31-048eb5322308 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:36.930295 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-af622626-fd18-4733-8d31-048eb5322308 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:36.930764 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-af622626-fd18-4733-8d31-048eb5322308 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:36.931222 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-af622626-fd18-4733-8d31-048eb5322308 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:36.961638 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-af622626-fd18-4733-8d31-048eb5322308 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046728 Oct 24 13:17:36.962185 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 344/672] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:17:36 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:17:37.973922 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-99e92a96-be41-484e-baba-1619584eae4a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:37.976830 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-99e92a96-be41-484e-baba-1619584eae4a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:37.983580 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-99e92a96-be41-484e-baba-1619584eae4a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:37.984065 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-99e92a96-be41-484e-baba-1619584eae4a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:37.984493 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-99e92a96-be41-484e-baba-1619584eae4a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:37.985177 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-99e92a96-be41-484e-baba-1619584eae4a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:37.985624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-99e92a96-be41-484e-baba-1619584eae4a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:37.986040 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-99e92a96-be41-484e-baba-1619584eae4a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:38.016247 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-99e92a96-be41-484e-baba-1619584eae4a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046281 Oct 24 13:17:38.016805 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 329/673] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:17:37 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:17:38.769972 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-81e72c8a-7bc2-43d1-a536-384b7c3ceed8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2b64738-b06d-4b87-b48a-247387d92923"}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:17:38.772947 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-81e72c8a-7bc2-43d1-a536-384b7c3ceed8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:38.779203 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-81e72c8a-7bc2-43d1-a536-384b7c3ceed8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:38.779681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-81e72c8a-7bc2-43d1-a536-384b7c3ceed8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:38.780111 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-81e72c8a-7bc2-43d1-a536-384b7c3ceed8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:38.780789 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-81e72c8a-7bc2-43d1-a536-384b7c3ceed8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:38.781230 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-81e72c8a-7bc2-43d1-a536-384b7c3ceed8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:38.781649 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-81e72c8a-7bc2-43d1-a536-384b7c3ceed8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:38.860267 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-81e72c8a-7bc2-43d1-a536-384b7c3ceed8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] HTTP exception thrown: Invalid volume: volume c2b64738-b06d-4b87-b48a-247387d92923 is already attached to instances: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 Oct 24 13:17:38.862010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-81e72c8a-7bc2-43d1-a536-384b7c3ceed8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Request method failure captured: Oct 24 13:17:38.862010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: POST /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5/os-volume_attachments HTTP/1.1 Oct 24 13:17:38.862010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:17:38.862010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:17:38.862010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:17:38.862010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 74 Oct 24 13:17:38.862010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:17:38.862010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:17:38.862010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:17:38.862010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:17:38.862010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVo9AXwMG0aRbejat92eCxhMJFSv0y7_lNyhuCUN6zXnDHpFGdG48-ggi2-Do-PEfXVv_XARCMCP2kZbyq19slbwuuFeg54REDqUjfIH_fbN8NXKvJLHQXv8L_GOaWATBtTB6QuD_0kWnm_UJtW2Xnio6IxEqQIshhCCIfC1pGYUCOsE Oct 24 13:17:38.862010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:17:38.862010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:17:38.862010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:17:38.862010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:17:38.862010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:17:38.862010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:17:38.862010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:17:38.862010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:17:38.862010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:17:38.862010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:17:38.863637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:17:38.863637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:17:38.863637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:17:38.863637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:17:38.863637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:17:38.863637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:17:38.863637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:17:38.863637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: c5619c8183e04e1d9073f1b40e057967 Oct 24 13:17:38.863637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:17:38.863637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Oct 24 13:17:38.863637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {"volumeAttachment": {"volumeId": "c2b64738-b06d-4b87-b48a-247387d92923"}} Oct 24 13:17:38.863637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:17:38.864531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Invalid volume: volume c2b64738-b06d-4b87-b48a-247387d92923 is already attached to instances: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 Oct 24 13:17:38.864531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'server_id': 'd1f32388-2b31-4b4f-be1e-1a6b04ce35a5', 'body': {'volumeAttachment': {'volumeId': 'c2b64738-b06d-4b87-b48a-247387d92923'}}} Oct 24 13:17:38.864531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:17:38.864531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:17:38.864531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 24 13:17:38.864531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 24 13:17:38.864531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 24 13:17:38.864531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 24 13:17:38.864531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 24 13:17:38.864531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 24 13:17:38.864531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 24 13:17:38.864531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 24 13:17:38.864531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 24 13:17:38.864531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 24 13:17:38.864531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c2b64738-b06d-4b87-b48a-247387d92923 is already attached to instances: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 Oct 24 13:17:38.864531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:17:38.864531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:17:38.864531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:17:38.864531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:17:38.865978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:17:38.865978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:17:38.865978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:17:38.865978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:17:38.865978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:17:38.865978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:17:38.865978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:17:38.865978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:17:38.865978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:17:38.865978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:17:38.865978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 24 13:17:38.865978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 24 13:17:38.865978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 24 13:17:38.865978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 24 13:17:38.865978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c2b64738-b06d-4b87-b48a-247387d92923 is already attached to instances: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 Oct 24 13:17:38.865978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:17:38.865978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:17:38.865978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:17:38.865978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:17:38.865978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:17:38.867510 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:17:38.867510 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:17:38.867510 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:17:38.867510 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c2b64738-b06d-4b87-b48a-247387d92923 is already attached to instances: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 Oct 24 13:17:38.867510 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:17:38.867510 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-81e72c8a-7bc2-43d1-a536-384b7c3ceed8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Returning 400 to user: Invalid volume: volume c2b64738-b06d-4b87-b48a-247387d92923 is already attached to instances: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:17:38.867510 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-81e72c8a-7bc2-43d1-a536-384b7c3ceed8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "POST /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097405 Oct 24 13:17:38.867510 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 345/674] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 24 13:17:38 2022] POST /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:17:38.931546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-567e115e-1770-421d-8c99-8acddd2a0362 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:38.932046 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-567e115e-1770-421d-8c99-8acddd2a0362 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:38.938159 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-567e115e-1770-421d-8c99-8acddd2a0362 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:38.938635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-567e115e-1770-421d-8c99-8acddd2a0362 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:38.939095 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-567e115e-1770-421d-8c99-8acddd2a0362 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:38.939778 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-567e115e-1770-421d-8c99-8acddd2a0362 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:38.940231 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-567e115e-1770-421d-8c99-8acddd2a0362 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:38.940653 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-567e115e-1770-421d-8c99-8acddd2a0362 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:39.021019 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.objects.instance [None req-567e115e-1770-421d-8c99-8acddd2a0362 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lazy-loading 'services' on Instance uuid d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 {{(pid=118915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:17:39.028866 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-921ace93-9a52-47c4-af5a-e86560118f88 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:39.030980 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-921ace93-9a52-47c4-af5a-e86560118f88 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:39.037738 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-921ace93-9a52-47c4-af5a-e86560118f88 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:39.038207 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-921ace93-9a52-47c4-af5a-e86560118f88 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:39.038612 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-921ace93-9a52-47c4-af5a-e86560118f88 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:39.039402 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-921ace93-9a52-47c4-af5a-e86560118f88 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:39.039858 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-921ace93-9a52-47c4-af5a-e86560118f88 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:39.040281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-921ace93-9a52-47c4-af5a-e86560118f88 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:39.069799 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-921ace93-9a52-47c4-af5a-e86560118f88 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044734 Oct 24 13:17:39.070363 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 346/675] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:17:39 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 13:17:39.100583 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-567e115e-1770-421d-8c99-8acddd2a0362 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5/os-volume_attachments/c2b64738-b06d-4b87-b48a-247387d92923" status: 202 len: 0 microversion: 2.1 time: 0.172946 Oct 24 13:17:39.101133 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 330/676] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 24 13:17:38 2022] DELETE /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5/os-volume_attachments/c2b64738-b06d-4b87-b48a-247387d92923 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:17:39.110129 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-05c8362e-079c-40f7-be1a-ef5ef600e1f0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:39.112370 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-05c8362e-079c-40f7-be1a-ef5ef600e1f0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:39.119446 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-05c8362e-079c-40f7-be1a-ef5ef600e1f0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:39.120089 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-05c8362e-079c-40f7-be1a-ef5ef600e1f0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:39.120751 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-05c8362e-079c-40f7-be1a-ef5ef600e1f0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:39.121517 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-05c8362e-079c-40f7-be1a-ef5ef600e1f0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:39.122228 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-05c8362e-079c-40f7-be1a-ef5ef600e1f0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:39.122669 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-05c8362e-079c-40f7-be1a-ef5ef600e1f0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:39.152071 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-0b2a818b-8b41-45e0-848e-03acfcee4ab2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:39.152453 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-0b2a818b-8b41-45e0-848e-03acfcee4ab2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:39.157893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-05c8362e-079c-40f7-be1a-ef5ef600e1f0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052398 Oct 24 13:17:39.158599 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 347/677] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:17:39 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:17:39.163079 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b2a818b-8b41-45e0-848e-03acfcee4ab2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:39.163079 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b2a818b-8b41-45e0-848e-03acfcee4ab2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:39.163079 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b2a818b-8b41-45e0-848e-03acfcee4ab2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:39.163079 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b2a818b-8b41-45e0-848e-03acfcee4ab2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:39.163783 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b2a818b-8b41-45e0-848e-03acfcee4ab2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:39.163783 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b2a818b-8b41-45e0-848e-03acfcee4ab2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:39.187559 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-0b2a818b-8b41-45e0-848e-03acfcee4ab2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Going to try to terminate instance {{(pid=118915) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:17:39.261212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-0b2a818b-8b41-45e0-848e-03acfcee4ab2 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 204 len: 0 microversion: 2.1 time: 0.112949 Oct 24 13:17:39.261790 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 331/678] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:17:39 2022] DELETE /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 13:17:39.269964 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-51be51c4-aec8-4a6f-8547-a1f04b2b47e3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:39.270638 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-51be51c4-aec8-4a6f-8547-a1f04b2b47e3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:39.276860 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-51be51c4-aec8-4a6f-8547-a1f04b2b47e3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:39.277345 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-51be51c4-aec8-4a6f-8547-a1f04b2b47e3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:39.277782 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-51be51c4-aec8-4a6f-8547-a1f04b2b47e3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:39.278516 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-51be51c4-aec8-4a6f-8547-a1f04b2b47e3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:39.278994 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-51be51c4-aec8-4a6f-8547-a1f04b2b47e3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:39.279465 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-51be51c4-aec8-4a6f-8547-a1f04b2b47e3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:39.413688 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-51be51c4-aec8-4a6f-8547-a1f04b2b47e3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:39.421315 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-51be51c4-aec8-4a6f-8547-a1f04b2b47e3 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1690 microversion: 2.1 time: 0.155423 Oct 24 13:17:39.421885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 348/679] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:39 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:40.170524 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9fdc0b22-a8d9-45af-b261-a22063986439 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:40.172765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9fdc0b22-a8d9-45af-b261-a22063986439 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:40.179083 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9fdc0b22-a8d9-45af-b261-a22063986439 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:40.179558 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9fdc0b22-a8d9-45af-b261-a22063986439 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:40.179992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9fdc0b22-a8d9-45af-b261-a22063986439 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:40.180676 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9fdc0b22-a8d9-45af-b261-a22063986439 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:40.181129 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9fdc0b22-a8d9-45af-b261-a22063986439 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:40.181551 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9fdc0b22-a8d9-45af-b261-a22063986439 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:40.211958 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-9fdc0b22-a8d9-45af-b261-a22063986439 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045733 Oct 24 13:17:40.212445 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 332/680] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:17:40 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:17:40.444760 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-362b703e-0349-4be2-849a-537d40871771 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:40.445366 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-362b703e-0349-4be2-849a-537d40871771 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:40.451841 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-362b703e-0349-4be2-849a-537d40871771 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:40.452298 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-362b703e-0349-4be2-849a-537d40871771 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:40.452740 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-362b703e-0349-4be2-849a-537d40871771 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:40.453456 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-362b703e-0349-4be2-849a-537d40871771 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:40.453906 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-362b703e-0349-4be2-849a-537d40871771 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:40.454322 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-362b703e-0349-4be2-849a-537d40871771 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:40.590205 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-362b703e-0349-4be2-849a-537d40871771 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:40.597821 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-362b703e-0349-4be2-849a-537d40871771 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1690 microversion: 2.1 time: 0.157559 Oct 24 13:17:40.598380 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 349/681] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:40 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:41.224269 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-2b18bc2c-357b-4130-84df-ce3e35990672 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:41.227017 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-2b18bc2c-357b-4130-84df-ce3e35990672 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:41.229546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:41.235524 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2b18bc2c-357b-4130-84df-ce3e35990672 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:41.236002 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2b18bc2c-357b-4130-84df-ce3e35990672 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:41.236433 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2b18bc2c-357b-4130-84df-ce3e35990672 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:41.237124 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2b18bc2c-357b-4130-84df-ce3e35990672 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:41.237575 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2b18bc2c-357b-4130-84df-ce3e35990672 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:41.237996 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2b18bc2c-357b-4130-84df-ce3e35990672 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:41.267809 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-2b18bc2c-357b-4130-84df-ce3e35990672 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047488 Oct 24 13:17:41.268368 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 333/682] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:17:41 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:17:41.620579 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c45625b4-0c08-4387-8553-716560f55467 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:41.621191 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-c45625b4-0c08-4387-8553-716560f55467 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:41.627720 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c45625b4-0c08-4387-8553-716560f55467 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:41.628203 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c45625b4-0c08-4387-8553-716560f55467 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:41.628637 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c45625b4-0c08-4387-8553-716560f55467 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:41.629333 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c45625b4-0c08-4387-8553-716560f55467 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:41.629789 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c45625b4-0c08-4387-8553-716560f55467 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:41.630218 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c45625b4-0c08-4387-8553-716560f55467 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:41.759976 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-c45625b4-0c08-4387-8553-716560f55467 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:41.768010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-c45625b4-0c08-4387-8553-716560f55467 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1690 microversion: 2.1 time: 0.151359 Oct 24 13:17:41.768578 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 350/683] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:41 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:42.280841 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-78bb1ab7-3b24-4d23-89f6-0e3ed46a68a1 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:42.282914 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-78bb1ab7-3b24-4d23-89f6-0e3ed46a68a1 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:42.289374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-78bb1ab7-3b24-4d23-89f6-0e3ed46a68a1 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:42.289846 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-78bb1ab7-3b24-4d23-89f6-0e3ed46a68a1 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:42.290269 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-78bb1ab7-3b24-4d23-89f6-0e3ed46a68a1 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:42.290951 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-78bb1ab7-3b24-4d23-89f6-0e3ed46a68a1 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:42.291425 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-78bb1ab7-3b24-4d23-89f6-0e3ed46a68a1 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:42.291837 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-78bb1ab7-3b24-4d23-89f6-0e3ed46a68a1 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:42.294157 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:42.323618 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-78bb1ab7-3b24-4d23-89f6-0e3ed46a68a1 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046897 Oct 24 13:17:42.324164 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 334/684] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:17:42 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:17:42.792364 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-2f5f65bf-e0b8-4141-a6ff-3e83610ee38c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:42.793353 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-2f5f65bf-e0b8-4141-a6ff-3e83610ee38c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:42.801156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f5f65bf-e0b8-4141-a6ff-3e83610ee38c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:42.801634 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f5f65bf-e0b8-4141-a6ff-3e83610ee38c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:42.802076 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f5f65bf-e0b8-4141-a6ff-3e83610ee38c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:42.802795 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f5f65bf-e0b8-4141-a6ff-3e83610ee38c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:42.803572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f5f65bf-e0b8-4141-a6ff-3e83610ee38c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:42.803996 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f5f65bf-e0b8-4141-a6ff-3e83610ee38c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:42.938499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-2f5f65bf-e0b8-4141-a6ff-3e83610ee38c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:42.946676 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-2f5f65bf-e0b8-4141-a6ff-3e83610ee38c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1690 microversion: 2.1 time: 0.158260 Oct 24 13:17:42.947189 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 351/685] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:42 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:43.337398 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-2f674531-c55b-424d-a863-e7d434613438 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:43.339607 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-2f674531-c55b-424d-a863-e7d434613438 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:43.346205 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2f674531-c55b-424d-a863-e7d434613438 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:43.346730 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2f674531-c55b-424d-a863-e7d434613438 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:43.347426 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2f674531-c55b-424d-a863-e7d434613438 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:43.348175 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2f674531-c55b-424d-a863-e7d434613438 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:43.349079 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2f674531-c55b-424d-a863-e7d434613438 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:43.349079 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2f674531-c55b-424d-a863-e7d434613438 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:43.378374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-2f674531-c55b-424d-a863-e7d434613438 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045705 Oct 24 13:17:43.378944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 335/686] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:17:43 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:17:43.445126 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c164da01-339e-4490-8dd3-b623771393b9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:43.445722 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-c164da01-339e-4490-8dd3-b623771393b9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:43.451695 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c164da01-339e-4490-8dd3-b623771393b9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:43.452179 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c164da01-339e-4490-8dd3-b623771393b9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:43.452630 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c164da01-339e-4490-8dd3-b623771393b9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:43.453382 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c164da01-339e-4490-8dd3-b623771393b9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:43.453856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c164da01-339e-4490-8dd3-b623771393b9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:43.454320 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c164da01-339e-4490-8dd3-b623771393b9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:43.479115 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-c164da01-339e-4490-8dd3-b623771393b9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Going to try to terminate instance {{(pid=118914) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:17:43.527095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:43.563259 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-c164da01-339e-4490-8dd3-b623771393b9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5" status: 204 len: 0 microversion: 2.1 time: 0.122581 Oct 24 13:17:43.564433 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 352/687] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:17:43 2022] DELETE /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:17:43.573475 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8b98f30b-8254-496e-ba4f-c55911c93b41 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:43.574180 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-8b98f30b-8254-496e-ba4f-c55911c93b41 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:43.581336 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8b98f30b-8254-496e-ba4f-c55911c93b41 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:43.581829 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8b98f30b-8254-496e-ba4f-c55911c93b41 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:43.582267 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8b98f30b-8254-496e-ba4f-c55911c93b41 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:43.582976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8b98f30b-8254-496e-ba4f-c55911c93b41 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:43.583452 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8b98f30b-8254-496e-ba4f-c55911c93b41 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:43.583879 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8b98f30b-8254-496e-ba4f-c55911c93b41 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:43.781213 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-8b98f30b-8254-496e-ba4f-c55911c93b41 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:43.789473 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-8b98f30b-8254-496e-ba4f-c55911c93b41 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5" status: 200 len: 1680 microversion: 2.1 time: 0.220682 Oct 24 13:17:43.790037 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 336/688] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:43 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:43.939147 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-c6402b0f-bbf9-4c31-b4de-0620c9953bad req-54d7b5f1-3ff7-4ddd-8c63-b016bbe7c18a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bd238e2-4223-465c-8028-c291fe1db874", "name": "network-vif-deleted", "tag": "b1289f23-07a5-45c6-9004-035914303827"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:17:43.949600 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-c6402b0f-bbf9-4c31-b4de-0620c9953bad req-54d7b5f1-3ff7-4ddd-8c63-b016bbe7c18a service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:43.950083 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-c6402b0f-bbf9-4c31-b4de-0620c9953bad req-54d7b5f1-3ff7-4ddd-8c63-b016bbe7c18a service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:43.950511 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-c6402b0f-bbf9-4c31-b4de-0620c9953bad req-54d7b5f1-3ff7-4ddd-8c63-b016bbe7c18a service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:43.965494 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-c6402b0f-bbf9-4c31-b4de-0620c9953bad req-54d7b5f1-3ff7-4ddd-8c63-b016bbe7c18a service nova] Creating event network-vif-deleted:b1289f23-07a5-45c6-9004-035914303827 for instance 6bd238e2-4223-465c-8028-c291fe1db874 on hv-cinder-86248 Oct 24 13:17:43.970565 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-c6402b0f-bbf9-4c31-b4de-0620c9953bad req-54d7b5f1-3ff7-4ddd-8c63-b016bbe7c18a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035391 Oct 24 13:17:43.974154 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 353/689] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:17:43.978364 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-0297e52d-b6d3-44be-b867-942619a6351a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:43.978994 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-0297e52d-b6d3-44be-b867-942619a6351a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:43.985366 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0297e52d-b6d3-44be-b867-942619a6351a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:43.985962 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0297e52d-b6d3-44be-b867-942619a6351a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:43.986475 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0297e52d-b6d3-44be-b867-942619a6351a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:43.987287 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0297e52d-b6d3-44be-b867-942619a6351a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:43.987870 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0297e52d-b6d3-44be-b867-942619a6351a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:43.988366 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0297e52d-b6d3-44be-b867-942619a6351a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:44.056468 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-0297e52d-b6d3-44be-b867-942619a6351a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:44.066366 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-0297e52d-b6d3-44be-b867-942619a6351a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1622 microversion: 2.1 time: 0.100420 Oct 24 13:17:44.069801 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 337/690] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:43 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1622 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:44.814590 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-22125f1f-7af9-45c8-bd71-1a44249e9988 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:44.815343 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-22125f1f-7af9-45c8-bd71-1a44249e9988 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:44.822041 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-22125f1f-7af9-45c8-bd71-1a44249e9988 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:44.822520 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-22125f1f-7af9-45c8-bd71-1a44249e9988 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:44.822950 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-22125f1f-7af9-45c8-bd71-1a44249e9988 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:44.823653 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-22125f1f-7af9-45c8-bd71-1a44249e9988 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:44.824108 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-22125f1f-7af9-45c8-bd71-1a44249e9988 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:44.824584 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-22125f1f-7af9-45c8-bd71-1a44249e9988 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:44.982414 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-22125f1f-7af9-45c8-bd71-1a44249e9988 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:44.995387 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-22125f1f-7af9-45c8-bd71-1a44249e9988 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5" status: 200 len: 1680 microversion: 2.1 time: 0.184860 Oct 24 13:17:44.995967 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 354/691] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:44 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:45.092506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-c03dda73-963d-44ae-845e-1b892ea5299f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:45.093117 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-c03dda73-963d-44ae-845e-1b892ea5299f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:45.100429 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c03dda73-963d-44ae-845e-1b892ea5299f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:45.100929 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c03dda73-963d-44ae-845e-1b892ea5299f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:45.101348 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c03dda73-963d-44ae-845e-1b892ea5299f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:45.102050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c03dda73-963d-44ae-845e-1b892ea5299f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:45.102506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c03dda73-963d-44ae-845e-1b892ea5299f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:45.102960 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c03dda73-963d-44ae-845e-1b892ea5299f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:45.137005 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c03dda73-963d-44ae-845e-1b892ea5299f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:45.137288 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c03dda73-963d-44ae-845e-1b892ea5299f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:45.137723 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c03dda73-963d-44ae-845e-1b892ea5299f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:45.138165 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.objects.instance [None req-c03dda73-963d-44ae-845e-1b892ea5299f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lazy-loading 'fault' on Instance uuid 6bd238e2-4223-465c-8028-c291fe1db874 {{(pid=118915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:17:45.188268 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-c03dda73-963d-44ae-845e-1b892ea5299f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:45.195887 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-c03dda73-963d-44ae-845e-1b892ea5299f tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 200 len: 1335 microversion: 2.1 time: 0.107367 Oct 24 13:17:45.196446 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 338/692] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:45 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 1335 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:46.020795 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-73056413-5ae2-4367-af3d-514a1152ccef tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:46.021330 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-73056413-5ae2-4367-af3d-514a1152ccef tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:46.028077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-73056413-5ae2-4367-af3d-514a1152ccef tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:46.028561 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-73056413-5ae2-4367-af3d-514a1152ccef tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:46.028993 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-73056413-5ae2-4367-af3d-514a1152ccef tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:46.029691 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-73056413-5ae2-4367-af3d-514a1152ccef tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:46.030143 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-73056413-5ae2-4367-af3d-514a1152ccef tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:46.030562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-73056413-5ae2-4367-af3d-514a1152ccef tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:46.098165 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-73056413-5ae2-4367-af3d-514a1152ccef tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:46.107454 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-73056413-5ae2-4367-af3d-514a1152ccef tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5" status: 200 len: 1612 microversion: 2.1 time: 0.090521 Oct 24 13:17:46.108034 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 355/693] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:46 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 => generated 1612 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:46.219586 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-3097dd5f-3809-4b37-abe0-d895d4f0dbe9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:46.220211 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-3097dd5f-3809-4b37-abe0-d895d4f0dbe9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6bd238e2-4223-465c-8028-c291fe1db874] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:46.227662 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3097dd5f-3809-4b37-abe0-d895d4f0dbe9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:46.228146 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3097dd5f-3809-4b37-abe0-d895d4f0dbe9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:46.228808 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3097dd5f-3809-4b37-abe0-d895d4f0dbe9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:46.229699 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3097dd5f-3809-4b37-abe0-d895d4f0dbe9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:46.230158 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3097dd5f-3809-4b37-abe0-d895d4f0dbe9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:46.230581 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3097dd5f-3809-4b37-abe0-d895d4f0dbe9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:46.246219 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-3097dd5f-3809-4b37-abe0-d895d4f0dbe9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] HTTP exception thrown: Instance 6bd238e2-4223-465c-8028-c291fe1db874 could not be found. Oct 24 13:17:46.247944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-3097dd5f-3809-4b37-abe0-d895d4f0dbe9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Request method failure captured: Oct 24 13:17:46.247944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 HTTP/1.1 Oct 24 13:17:46.247944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:17:46.247944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:17:46.247944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:17:46.247944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:17:46.247944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:17:46.247944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:17:46.247944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:17:46.247944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:17:46.247944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo8-MVUZt3eqKP9axHhN9-YGEl3TZduwFjpEinzp6vl_5EPjxspkm0YjnuEeX52n_zMOBC2DHbIvahT4eFkJ4bpeh_VkPLMHqyH0kf3GvMdexv9ZvJHWuw2mGfp1Tv9L3Xia6cV13F533nQVQsLnKzwUhe5Mqd9rFhScRAi468eY_Qw Oct 24 13:17:46.247944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:17:46.247944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:17:46.247944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:17:46.247944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:17:46.247944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:17:46.247944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:17:46.247944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: 85d62dec32104e7b8c595953a479026b Oct 24 13:17:46.247944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2008376724 Oct 24 13:17:46.247944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:17:46.247944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:17:46.249277 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/85d62dec32104e7b8c595953a479026b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/85d62dec32104e7b8c595953a479026b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/85d62dec32104e7b8c595953a479026b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_85d62dec32104e7b8c595953a479026b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:17:46.249277 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2008376724 Oct 24 13:17:46.249277 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: 85d62dec32104e7b8c595953a479026b Oct 24 13:17:46.249277 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2008376724 Oct 24 13:17:46.249277 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-ServerRescueNegativeTestJSON-2008376724-project Oct 24 13:17:46.249277 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:17:46.249277 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:17:46.249277 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: d29ff25b062346f6bcf9910b1fa8db5c Oct 24 13:17:46.249277 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2008376724-project Oct 24 13:17:46.249277 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:17:46.249277 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Instance 6bd238e2-4223-465c-8028-c291fe1db874 could not be found. Oct 24 13:17:46.249277 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': '6bd238e2-4223-465c-8028-c291fe1db874'} Oct 24 13:17:46.250021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:17:46.250021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:17:46.250021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:17:46.250021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:17:46.250021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:17:46.250021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:17:46.250021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:17:46.250021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:17:46.250021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:17:46.250021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:17:46.250021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bd238e2-4223-465c-8028-c291fe1db874 could not be found. Oct 24 13:17:46.250021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:17:46.250021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:17:46.250021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:17:46.250021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:17:46.250021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:17:46.250021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:17:46.250021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:17:46.250021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:17:46.250021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:17:46.251251 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:17:46.251251 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:17:46.251251 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:17:46.251251 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:17:46.251251 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:17:46.251251 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:17:46.251251 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:17:46.251251 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bd238e2-4223-465c-8028-c291fe1db874 could not be found. Oct 24 13:17:46.251251 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:17:46.251251 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:17:46.251251 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:17:46.251251 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:17:46.251251 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:17:46.251251 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:17:46.251251 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:17:46.251251 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:17:46.251251 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bd238e2-4223-465c-8028-c291fe1db874 could not be found. Oct 24 13:17:46.251251 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:17:46.252979 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-3097dd5f-3809-4b37-abe0-d895d4f0dbe9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Returning 404 to user: Instance 6bd238e2-4223-465c-8028-c291fe1db874 could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:17:46.252979 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-3097dd5f-3809-4b37-abe0-d895d4f0dbe9 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874" status: 404 len: 111 microversion: 2.1 time: 0.034624 Oct 24 13:17:46.260225 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-5cb52e46-8772-48c7-8f58-043cc93c733e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '.version_select at 0x7fad2848a3a0>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:46.265720 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 339/694] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:46 2022] GET /compute/v2.1/servers/6bd238e2-4223-465c-8028-c291fe1db874 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:17:46.286636 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-5cb52e46-8772-48c7-8f58-043cc93c733e tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921618364" status: 202 len: 0 microversion: 2.1 time: 0.028678 Oct 24 13:17:46.291914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 356/695] 10.222.0.42 () {58 vars in 1221 bytes} [Mon Oct 24 13:17:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1921618364 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:17:46.324471 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-2459bf54-7bad-4974-8d7f-ef93aade165c req-f45ce4dc-5b6a-4369-b0eb-15303f061642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f32388-2b31-4b4f-be1e-1a6b04ce35a5", "name": "network-vif-deleted", "tag": "f22388f7-ae14-4f13-95c4-629680f0fec8"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:17:46.337867 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-2459bf54-7bad-4974-8d7f-ef93aade165c req-f45ce4dc-5b6a-4369-b0eb-15303f061642 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:46.338347 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-2459bf54-7bad-4974-8d7f-ef93aade165c req-f45ce4dc-5b6a-4369-b0eb-15303f061642 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:46.338998 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-2459bf54-7bad-4974-8d7f-ef93aade165c req-f45ce4dc-5b6a-4369-b0eb-15303f061642 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:46.354070 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-2459bf54-7bad-4974-8d7f-ef93aade165c req-f45ce4dc-5b6a-4369-b0eb-15303f061642 service nova] Creating event network-vif-deleted:f22388f7-ae14-4f13-95c4-629680f0fec8 for instance d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 on hv-cinder-86248 Oct 24 13:17:46.361030 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-2459bf54-7bad-4974-8d7f-ef93aade165c req-f45ce4dc-5b6a-4369-b0eb-15303f061642 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040215 Oct 24 13:17:46.361643 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 340/696] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:17:47.132128 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a572ad10-93d3-43e3-9ed4-db3379b50d60 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:47.133524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a572ad10-93d3-43e3-9ed4-db3379b50d60 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:47.140357 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a572ad10-93d3-43e3-9ed4-db3379b50d60 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:47.140922 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a572ad10-93d3-43e3-9ed4-db3379b50d60 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:47.141427 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a572ad10-93d3-43e3-9ed4-db3379b50d60 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:47.142189 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a572ad10-93d3-43e3-9ed4-db3379b50d60 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:47.142718 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a572ad10-93d3-43e3-9ed4-db3379b50d60 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:47.143246 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a572ad10-93d3-43e3-9ed4-db3379b50d60 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:47.158188 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-a572ad10-93d3-43e3-9ed4-db3379b50d60 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] HTTP exception thrown: Instance d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 could not be found. Oct 24 13:17:47.159938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a572ad10-93d3-43e3-9ed4-db3379b50d60 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Request method failure captured: Oct 24 13:17:47.159938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 HTTP/1.1 Oct 24 13:17:47.159938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:17:47.159938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:17:47.159938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:17:47.159938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:17:47.159938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:17:47.159938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:17:47.159938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:17:47.159938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:17:47.159938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVo9AXwMG0aRbejat92eCxhMJFSv0y7_lNyhuCUN6zXnDHpFGdG48-ggi2-Do-PEfXVv_XARCMCP2kZbyq19slbwuuFeg54REDqUjfIH_fbN8NXKvJLHQXv8L_GOaWATBtTB6QuD_0kWnm_UJtW2Xnio6IxEqQIshhCCIfC1pGYUCOsE Oct 24 13:17:47.159938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:17:47.159938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:17:47.159938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:17:47.159938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:17:47.159938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:17:47.159938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:17:47.159938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:17:47.159938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:17:47.159938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:17:47.159938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:17:47.161462 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:17:47.161462 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:17:47.161462 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:17:47.161462 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:17:47.161462 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:17:47.161462 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:17:47.161462 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:17:47.161462 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: c5619c8183e04e1d9073f1b40e057967 Oct 24 13:17:47.161462 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:17:47.161462 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:17:47.161462 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Instance d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 could not be found. Oct 24 13:17:47.161462 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': 'd1f32388-2b31-4b4f-be1e-1a6b04ce35a5'} Oct 24 13:17:47.162398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:17:47.162398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:17:47.162398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:17:47.162398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:17:47.162398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:17:47.162398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:17:47.162398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:17:47.162398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:17:47.162398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:17:47.162398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:17:47.162398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 could not be found. Oct 24 13:17:47.162398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:17:47.162398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:17:47.162398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:17:47.162398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:17:47.162398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:17:47.162398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:17:47.162398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:17:47.162398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:17:47.162398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:17:47.163995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:17:47.163995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:17:47.163995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:17:47.163995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:17:47.163995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:17:47.163995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:17:47.163995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:17:47.163995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 could not be found. Oct 24 13:17:47.163995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:17:47.163995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:17:47.163995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:17:47.163995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:17:47.163995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:17:47.163995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:17:47.163995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:17:47.163995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:17:47.163995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 could not be found. Oct 24 13:17:47.163995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:17:47.165563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a572ad10-93d3-43e3-9ed4-db3379b50d60 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Returning 404 to user: Instance d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:17:47.165563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a572ad10-93d3-43e3-9ed4-db3379b50d60 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5" status: 404 len: 111 microversion: 2.1 time: 0.035441 Oct 24 13:17:47.165563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 357/697] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:47 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:17:47.174298 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9ec1cb0e-a5e3-4df9-8e1e-8c8dc887387b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '.version_select at 0x7fad284d84c0>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:47.195607 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-9ec1cb0e-a5e3-4df9-8e1e-8c8dc887387b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-317416502" status: 202 len: 0 microversion: 2.1 time: 0.025299 Oct 24 13:17:47.196198 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 341/698] 10.222.0.42 () {58 vars in 1218 bytes} [Mon Oct 24 13:17:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-317416502 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:17:47.855022 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-6d967998-7c54-4927-ad09-d1d5cc5ae41f tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Action: 'create', calling method: .version_select at 0x7fad28527160>, body: {"keypair": {"name": "tempest-keypair-152508036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbYP0sFlCbRVInYiIyLxtEW9cVldD38rrMfPeq7SfHHLA1K8xveTsbz0CCkc4FcPmXMMSaP4tuFB7CmSywHfhOStPMifmL4CQYhsyfc6yaoR5SN/4CqjwrpNsfpKtMToQ=="}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:17:47.870312 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-6d967998-7c54-4927-ad09-d1d5cc5ae41f tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Getting quotas for project 69beb82dd21b447d8a784e0570c4323c. Resources: {'key_pairs'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:17:47.874055 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-6d967998-7c54-4927-ad09-d1d5cc5ae41f tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Getting quotas for user c5619c8183e04e1d9073f1b40e057967 and project 69beb82dd21b447d8a784e0570c4323c. Resources: {'key_pairs'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:17:47.895331 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-6d967998-7c54-4927-ad09-d1d5cc5ae41f tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044169 Oct 24 13:17:47.895900 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 358/699] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Oct 24 13:17:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:17:49.132713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8a58608a-6725-43cf-a93f-9fa9b5572322 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1825523328", "imageRef": "4d2e5f3e-4aee-48d2-8ada-0b420d141f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a05f0bd2-3e3c-4265-bb55-173e62bd1853"}], "security_groups": [{"name": "tempest-securitygroup--711446459"}], "key_name": "tempest-keypair-152508036", "user_data": "}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:17:49.236858 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.network.neutron [None req-8a58608a-6725-43cf-a93f-9fa9b5572322 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] validate_networks() for [('a05f0bd2-3e3c-4265-bb55-173e62bd1853', None, None, None, None, None)] {{(pid=118915) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:17:49.312669 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-8ec96685-f5d3-4c86-a16b-2d12202c2c09 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:49.313257 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-8ec96685-f5d3-4c86-a16b-2d12202c2c09 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:49.320636 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8ec96685-f5d3-4c86-a16b-2d12202c2c09 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:49.321205 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8ec96685-f5d3-4c86-a16b-2d12202c2c09 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:49.321712 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8ec96685-f5d3-4c86-a16b-2d12202c2c09 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:49.322478 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8ec96685-f5d3-4c86-a16b-2d12202c2c09 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:49.323007 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8ec96685-f5d3-4c86-a16b-2d12202c2c09 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:49.323528 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8ec96685-f5d3-4c86-a16b-2d12202c2c09 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:49.347924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-8ec96685-f5d3-4c86-a16b-2d12202c2c09 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Going to try to terminate instance {{(pid=118914) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:17:49.430157 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-8ec96685-f5d3-4c86-a16b-2d12202c2c09 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 204 len: 0 microversion: 2.1 time: 0.119528 Oct 24 13:17:49.431174 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 359/700] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:17:49 2022] DELETE /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 13:17:49.439632 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-05bd9f59-471c-4af5-a3be-822139ebbcfc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:49.440337 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-05bd9f59-471c-4af5-a3be-822139ebbcfc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:49.446430 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-05bd9f59-471c-4af5-a3be-822139ebbcfc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:49.446939 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-05bd9f59-471c-4af5-a3be-822139ebbcfc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:49.447410 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-05bd9f59-471c-4af5-a3be-822139ebbcfc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:49.448138 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-05bd9f59-471c-4af5-a3be-822139ebbcfc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:49.448764 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-05bd9f59-471c-4af5-a3be-822139ebbcfc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:49.449192 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-05bd9f59-471c-4af5-a3be-822139ebbcfc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:49.581303 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-05bd9f59-471c-4af5-a3be-822139ebbcfc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:49.589070 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-05bd9f59-471c-4af5-a3be-822139ebbcfc tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1508 microversion: 2.1 time: 0.153763 Oct 24 13:17:49.589666 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 360/701] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:49 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:17:49.726861 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-8a58608a-6725-43cf-a93f-9fa9b5572322 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Flavor limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:17:49.727305 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-8a58608a-6725-43cf-a93f-9fa9b5572322 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Image limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:17:49.727774 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-8a58608a-6725-43cf-a93f-9fa9b5572322 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Flavor pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:17:49.728180 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-8a58608a-6725-43cf-a93f-9fa9b5572322 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Image pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:17:49.728582 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-8a58608a-6725-43cf-a93f-9fa9b5572322 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:17:49.737932 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8a58608a-6725-43cf-a93f-9fa9b5572322 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:49.738407 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8a58608a-6725-43cf-a93f-9fa9b5572322 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:49.738838 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8a58608a-6725-43cf-a93f-9fa9b5572322 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:49.739584 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8a58608a-6725-43cf-a93f-9fa9b5572322 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:49.740036 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8a58608a-6725-43cf-a93f-9fa9b5572322 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:49.740488 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8a58608a-6725-43cf-a93f-9fa9b5572322 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:49.757265 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-8a58608a-6725-43cf-a93f-9fa9b5572322 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Getting quotas for project 69beb82dd21b447d8a784e0570c4323c. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:17:49.761382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-8a58608a-6725-43cf-a93f-9fa9b5572322 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Getting quotas for user c5619c8183e04e1d9073f1b40e057967 and project 69beb82dd21b447d8a784e0570c4323c. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:17:49.772226 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-8a58608a-6725-43cf-a93f-9fa9b5572322 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Going to run 1 instances... {{(pid=118915) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:17:49.774626 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-8a58608a-6725-43cf-a93f-9fa9b5572322 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4d2e5f3e-4aee-48d2-8ada-0b420d141f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:17:49.823383 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-8a58608a-6725-43cf-a93f-9fa9b5572322 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.695475 Oct 24 13:17:49.823964 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 342/702] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 24 13:17:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:17:49.835188 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-b99959aa-2d56-4c52-a21d-1f3ab1a8b718 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:49.835871 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-b99959aa-2d56-4c52-a21d-1f3ab1a8b718 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:49.893282 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-b99959aa-2d56-4c52-a21d-1f3ab1a8b718 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:49.900323 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-b99959aa-2d56-4c52-a21d-1f3ab1a8b718 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e" status: 200 len: 1241 microversion: 2.1 time: 0.069145 Oct 24 13:17:49.901128 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 361/703] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:49 2022] GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:50.612444 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-3a928aa0-585b-4d7b-965e-3713cd5f8eeb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:50.613087 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-3a928aa0-585b-4d7b-965e-3713cd5f8eeb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:50.621253 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3a928aa0-585b-4d7b-965e-3713cd5f8eeb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:50.621817 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3a928aa0-585b-4d7b-965e-3713cd5f8eeb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:50.622274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3a928aa0-585b-4d7b-965e-3713cd5f8eeb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:50.622962 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3a928aa0-585b-4d7b-965e-3713cd5f8eeb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:50.623514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3a928aa0-585b-4d7b-965e-3713cd5f8eeb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:50.623943 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3a928aa0-585b-4d7b-965e-3713cd5f8eeb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:50.752225 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-3a928aa0-585b-4d7b-965e-3713cd5f8eeb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:50.760350 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-3a928aa0-585b-4d7b-965e-3713cd5f8eeb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1508 microversion: 2.1 time: 0.151853 Oct 24 13:17:50.761185 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 343/704] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:50 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:50.923847 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-4b2f5d0c-57b7-4d02-bf35-c22d2af25316 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:50.924491 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-4b2f5d0c-57b7-4d02-bf35-c22d2af25316 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:50.931652 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4b2f5d0c-57b7-4d02-bf35-c22d2af25316 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:50.932135 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4b2f5d0c-57b7-4d02-bf35-c22d2af25316 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:50.932570 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4b2f5d0c-57b7-4d02-bf35-c22d2af25316 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:50.933261 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4b2f5d0c-57b7-4d02-bf35-c22d2af25316 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:50.933736 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4b2f5d0c-57b7-4d02-bf35-c22d2af25316 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:50.934179 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4b2f5d0c-57b7-4d02-bf35-c22d2af25316 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:50.994600 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-4b2f5d0c-57b7-4d02-bf35-c22d2af25316 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:51.003901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-4b2f5d0c-57b7-4d02-bf35-c22d2af25316 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e" status: 200 len: 1245 microversion: 2.1 time: 0.082664 Oct 24 13:17:51.003901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 362/705] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:50 2022] GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:51.782698 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-fbc9174b-ecf0-4a43-b4ca-b781d3a08980 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:51.783326 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-fbc9174b-ecf0-4a43-b4ca-b781d3a08980 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:51.789647 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fbc9174b-ecf0-4a43-b4ca-b781d3a08980 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:51.790121 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fbc9174b-ecf0-4a43-b4ca-b781d3a08980 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:51.790551 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fbc9174b-ecf0-4a43-b4ca-b781d3a08980 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:51.791270 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fbc9174b-ecf0-4a43-b4ca-b781d3a08980 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:51.791721 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fbc9174b-ecf0-4a43-b4ca-b781d3a08980 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:51.792178 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fbc9174b-ecf0-4a43-b4ca-b781d3a08980 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:52.018450 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-fbc9174b-ecf0-4a43-b4ca-b781d3a08980 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:52.025787 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-02e07f05-b377-4420-a994-105f15bdf5cd tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:52.026596 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-fbc9174b-ecf0-4a43-b4ca-b781d3a08980 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1508 microversion: 2.1 time: 0.247654 Oct 24 13:17:52.026986 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-02e07f05-b377-4420-a994-105f15bdf5cd tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:52.027482 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 344/706] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:51 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1508 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:52.034001 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02e07f05-b377-4420-a994-105f15bdf5cd tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:52.034531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02e07f05-b377-4420-a994-105f15bdf5cd tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:52.034994 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02e07f05-b377-4420-a994-105f15bdf5cd tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:52.035758 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02e07f05-b377-4420-a994-105f15bdf5cd tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:52.036219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02e07f05-b377-4420-a994-105f15bdf5cd tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:52.036642 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02e07f05-b377-4420-a994-105f15bdf5cd tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:52.099939 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-02e07f05-b377-4420-a994-105f15bdf5cd tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:52.107642 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-02e07f05-b377-4420-a994-105f15bdf5cd tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e" status: 200 len: 1293 microversion: 2.1 time: 0.085715 Oct 24 13:17:52.108214 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 363/707] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:52 2022] GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:17:52.360819 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-c5032d9d-c2e1-4095-93b7-97f297f9361f req-f84aaf84-9a62-4dd2-9d98-9875a5f4990e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aac99c2-2d97-41c4-b44c-629b52631804", "name": "network-vif-deleted", "tag": "763cd320-528d-4a92-b74f-cd47217f446b"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:17:52.378553 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-c5032d9d-c2e1-4095-93b7-97f297f9361f req-f84aaf84-9a62-4dd2-9d98-9875a5f4990e service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:52.380832 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-c5032d9d-c2e1-4095-93b7-97f297f9361f req-f84aaf84-9a62-4dd2-9d98-9875a5f4990e service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:52.382303 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-c5032d9d-c2e1-4095-93b7-97f297f9361f req-f84aaf84-9a62-4dd2-9d98-9875a5f4990e service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:52.401965 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-c5032d9d-c2e1-4095-93b7-97f297f9361f req-f84aaf84-9a62-4dd2-9d98-9875a5f4990e service nova] Creating event network-vif-deleted:763cd320-528d-4a92-b74f-cd47217f446b for instance 6aac99c2-2d97-41c4-b44c-629b52631804 on hv-cinder-86248 Oct 24 13:17:52.407933 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-c5032d9d-c2e1-4095-93b7-97f297f9361f req-f84aaf84-9a62-4dd2-9d98-9875a5f4990e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057930 Oct 24 13:17:52.409426 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 345/708] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:17:53.049539 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-87031a65-4b81-4f71-ac7d-929e69622fad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:53.055651 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-87031a65-4b81-4f71-ac7d-929e69622fad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:53.067766 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-87031a65-4b81-4f71-ac7d-929e69622fad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:53.068272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-87031a65-4b81-4f71-ac7d-929e69622fad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:53.068697 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-87031a65-4b81-4f71-ac7d-929e69622fad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:53.069603 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-87031a65-4b81-4f71-ac7d-929e69622fad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:53.070061 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-87031a65-4b81-4f71-ac7d-929e69622fad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:53.070486 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-87031a65-4b81-4f71-ac7d-929e69622fad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:53.111879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-87031a65-4b81-4f71-ac7d-929e69622fad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:53.112922 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-87031a65-4b81-4f71-ac7d-929e69622fad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:53.113047 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-87031a65-4b81-4f71-ac7d-929e69622fad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:53.114375 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.objects.instance [None req-87031a65-4b81-4f71-ac7d-929e69622fad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lazy-loading 'fault' on Instance uuid 6aac99c2-2d97-41c4-b44c-629b52631804 {{(pid=118914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:17:53.134248 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-f225f55a-6d00-4ece-bdeb-580292f3382a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:53.139961 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-f225f55a-6d00-4ece-bdeb-580292f3382a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:53.150901 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f225f55a-6d00-4ece-bdeb-580292f3382a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:53.151526 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f225f55a-6d00-4ece-bdeb-580292f3382a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:53.152202 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f225f55a-6d00-4ece-bdeb-580292f3382a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:53.153120 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f225f55a-6d00-4ece-bdeb-580292f3382a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:53.154469 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f225f55a-6d00-4ece-bdeb-580292f3382a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:53.155138 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f225f55a-6d00-4ece-bdeb-580292f3382a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:53.187745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-87031a65-4b81-4f71-ac7d-929e69622fad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:53.199919 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-87031a65-4b81-4f71-ac7d-929e69622fad tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 200 len: 1311 microversion: 2.1 time: 0.154250 Oct 24 13:17:53.201182 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 364/709] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:53 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 1311 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:53.325175 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-f225f55a-6d00-4ece-bdeb-580292f3382a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:53.333040 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-f225f55a-6d00-4ece-bdeb-580292f3382a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e" status: 200 len: 1366 microversion: 2.1 time: 0.204823 Oct 24 13:17:53.333602 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 346/710] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:53 2022] GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:17:54.031590 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-5c10a163-5a07-4de5-8a9b-63694203ccd7 req-11a76c63-3861-4f1b-a4e3-cd780db5ce77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f52b209f-c997-4d1b-9ecf-a4fdc033b64e", "tag": "170c174e-102a-43bf-931e-57ccc699cfd2"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:17:54.041930 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-5c10a163-5a07-4de5-8a9b-63694203ccd7 req-11a76c63-3861-4f1b-a4e3-cd780db5ce77 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:54.042408 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-5c10a163-5a07-4de5-8a9b-63694203ccd7 req-11a76c63-3861-4f1b-a4e3-cd780db5ce77 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:54.042833 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-5c10a163-5a07-4de5-8a9b-63694203ccd7 req-11a76c63-3861-4f1b-a4e3-cd780db5ce77 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:54.054687 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-5c10a163-5a07-4de5-8a9b-63694203ccd7 req-11a76c63-3861-4f1b-a4e3-cd780db5ce77 service nova] Creating event network-changed:170c174e-102a-43bf-931e-57ccc699cfd2 for instance f52b209f-c997-4d1b-9ecf-a4fdc033b64e on hv-cinder-86248 Oct 24 13:17:54.059741 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-5c10a163-5a07-4de5-8a9b-63694203ccd7 req-11a76c63-3861-4f1b-a4e3-cd780db5ce77 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100570 Oct 24 13:17:54.060356 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 365/711] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:17:54.226121 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8e1e7754-4e3c-40f2-9c5b-b1e932297355 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:54.226669 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-8e1e7754-4e3c-40f2-9c5b-b1e932297355 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 6aac99c2-2d97-41c4-b44c-629b52631804] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:54.233157 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8e1e7754-4e3c-40f2-9c5b-b1e932297355 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:54.233642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8e1e7754-4e3c-40f2-9c5b-b1e932297355 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:54.234078 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8e1e7754-4e3c-40f2-9c5b-b1e932297355 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:54.234779 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8e1e7754-4e3c-40f2-9c5b-b1e932297355 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:54.235266 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8e1e7754-4e3c-40f2-9c5b-b1e932297355 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:54.235690 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8e1e7754-4e3c-40f2-9c5b-b1e932297355 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:54.250141 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-8e1e7754-4e3c-40f2-9c5b-b1e932297355 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] HTTP exception thrown: Instance 6aac99c2-2d97-41c4-b44c-629b52631804 could not be found. Oct 24 13:17:54.251798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8e1e7754-4e3c-40f2-9c5b-b1e932297355 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Request method failure captured: Oct 24 13:17:54.251798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 HTTP/1.1 Oct 24 13:17:54.251798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:17:54.251798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:17:54.251798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:17:54.251798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:17:54.251798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:17:54.251798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:17:54.251798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:17:54.251798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:17:54.251798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo8-MVUZt3eqKP9axHhN9-YGEl3TZduwFjpEinzp6vl_5EPjxspkm0YjnuEeX52n_zMOBC2DHbIvahT4eFkJ4bpeh_VkPLMHqyH0kf3GvMdexv9ZvJHWuw2mGfp1Tv9L3Xia6cV13F533nQVQsLnKzwUhe5Mqd9rFhScRAi468eY_Qw Oct 24 13:17:54.251798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:17:54.251798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:17:54.251798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:17:54.251798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:17:54.251798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:17:54.251798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:17:54.251798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: 85d62dec32104e7b8c595953a479026b Oct 24 13:17:54.251798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2008376724 Oct 24 13:17:54.251798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:17:54.251798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:17:54.253338 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/85d62dec32104e7b8c595953a479026b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/85d62dec32104e7b8c595953a479026b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/85d62dec32104e7b8c595953a479026b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_85d62dec32104e7b8c595953a479026b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:17:54.253338 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2008376724 Oct 24 13:17:54.253338 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: 85d62dec32104e7b8c595953a479026b Oct 24 13:17:54.253338 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2008376724 Oct 24 13:17:54.253338 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-ServerRescueNegativeTestJSON-2008376724-project Oct 24 13:17:54.253338 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:17:54.253338 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:17:54.253338 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: d29ff25b062346f6bcf9910b1fa8db5c Oct 24 13:17:54.253338 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2008376724-project Oct 24 13:17:54.253338 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:17:54.253338 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Instance 6aac99c2-2d97-41c4-b44c-629b52631804 could not be found. Oct 24 13:17:54.253338 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': '6aac99c2-2d97-41c4-b44c-629b52631804'} Oct 24 13:17:54.254227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:17:54.254227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:17:54.254227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:17:54.254227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:17:54.254227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:17:54.254227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:17:54.254227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:17:54.254227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:17:54.254227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:17:54.254227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:17:54.254227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aac99c2-2d97-41c4-b44c-629b52631804 could not be found. Oct 24 13:17:54.254227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:17:54.254227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:17:54.254227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:17:54.254227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:17:54.254227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:17:54.254227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:17:54.254227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:17:54.254227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:17:54.254227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:17:54.255949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:17:54.255949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:17:54.255949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:17:54.255949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:17:54.255949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:17:54.255949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:17:54.255949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:17:54.255949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aac99c2-2d97-41c4-b44c-629b52631804 could not be found. Oct 24 13:17:54.255949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:17:54.255949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:17:54.255949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:17:54.255949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:17:54.255949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:17:54.255949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:17:54.255949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:17:54.255949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:17:54.255949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aac99c2-2d97-41c4-b44c-629b52631804 could not be found. Oct 24 13:17:54.255949 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:17:54.257377 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8e1e7754-4e3c-40f2-9c5b-b1e932297355 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Returning 404 to user: Instance 6aac99c2-2d97-41c4-b44c-629b52631804 could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:17:54.257377 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-8e1e7754-4e3c-40f2-9c5b-b1e932297355 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804" status: 404 len: 111 microversion: 2.1 time: 0.031734 Oct 24 13:17:54.257613 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 347/712] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:54 2022] GET /compute/v2.1/servers/6aac99c2-2d97-41c4-b44c-629b52631804 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:17:54.264976 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-0c240f19-1883-418f-9a44-41ad346a456a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:54.266154 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-0c240f19-1883-418f-9a44-41ad346a456a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:54.272146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0c240f19-1883-418f-9a44-41ad346a456a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:54.272626 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0c240f19-1883-418f-9a44-41ad346a456a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:54.273077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0c240f19-1883-418f-9a44-41ad346a456a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:54.273760 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0c240f19-1883-418f-9a44-41ad346a456a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:54.274209 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0c240f19-1883-418f-9a44-41ad346a456a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:54.274630 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0c240f19-1883-418f-9a44-41ad346a456a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:54.300580 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-0c240f19-1883-418f-9a44-41ad346a456a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Going to try to terminate instance {{(pid=118914) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:17:54.358281 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9848f004-d867-49bc-84b9-f8df9e3cb629 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:54.358895 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9848f004-d867-49bc-84b9-f8df9e3cb629 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:54.364953 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9848f004-d867-49bc-84b9-f8df9e3cb629 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:54.365604 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9848f004-d867-49bc-84b9-f8df9e3cb629 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:54.366738 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9848f004-d867-49bc-84b9-f8df9e3cb629 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:54.367662 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9848f004-d867-49bc-84b9-f8df9e3cb629 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:54.368439 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9848f004-d867-49bc-84b9-f8df9e3cb629 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:54.368873 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9848f004-d867-49bc-84b9-f8df9e3cb629 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:54.386273 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-0c240f19-1883-418f-9a44-41ad346a456a tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 204 len: 0 microversion: 2.1 time: 0.125570 Oct 24 13:17:54.387427 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 366/713] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:17:54 2022] DELETE /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:17:54.398075 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-81afea06-76eb-474b-806b-38f2920432ba tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:54.398777 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-81afea06-76eb-474b-806b-38f2920432ba tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:54.405129 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-81afea06-76eb-474b-806b-38f2920432ba tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:54.405622 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-81afea06-76eb-474b-806b-38f2920432ba tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:54.406055 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-81afea06-76eb-474b-806b-38f2920432ba tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:54.406765 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-81afea06-76eb-474b-806b-38f2920432ba tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:54.407258 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-81afea06-76eb-474b-806b-38f2920432ba tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:54.407683 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-81afea06-76eb-474b-806b-38f2920432ba tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:54.550899 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-81afea06-76eb-474b-806b-38f2920432ba tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:54.558832 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-81afea06-76eb-474b-806b-38f2920432ba tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.166702 Oct 24 13:17:54.559433 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 367/714] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:54 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:54.667498 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-9848f004-d867-49bc-84b9-f8df9e3cb629 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:54.674958 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-9848f004-d867-49bc-84b9-f8df9e3cb629 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e" status: 200 len: 1366 microversion: 2.1 time: 0.321664 Oct 24 13:17:54.675539 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 348/715] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:54 2022] GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:55.582069 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-50996b13-d7ba-4326-8c35-211089a0f29c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:55.582683 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-50996b13-d7ba-4326-8c35-211089a0f29c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:55.589589 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-50996b13-d7ba-4326-8c35-211089a0f29c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:55.590067 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-50996b13-d7ba-4326-8c35-211089a0f29c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:55.590497 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-50996b13-d7ba-4326-8c35-211089a0f29c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:55.591213 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-50996b13-d7ba-4326-8c35-211089a0f29c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:55.591729 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-50996b13-d7ba-4326-8c35-211089a0f29c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:55.592156 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-50996b13-d7ba-4326-8c35-211089a0f29c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:55.630006 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a1bc34a7-b759-4c0f-b1b1-7cea352ba458 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:55.630628 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a1bc34a7-b759-4c0f-b1b1-7cea352ba458 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:55.637400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a1bc34a7-b759-4c0f-b1b1-7cea352ba458 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:55.638139 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a1bc34a7-b759-4c0f-b1b1-7cea352ba458 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:55.638605 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a1bc34a7-b759-4c0f-b1b1-7cea352ba458 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:55.639254 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a1bc34a7-b759-4c0f-b1b1-7cea352ba458 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:55.639707 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a1bc34a7-b759-4c0f-b1b1-7cea352ba458 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:55.640310 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a1bc34a7-b759-4c0f-b1b1-7cea352ba458 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:55.666769 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a1bc34a7-b759-4c0f-b1b1-7cea352ba458 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528/ips" status: 200 len: 152 microversion: 2.20 time: 0.143585 Oct 24 13:17:55.667601 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 368/716] 10.222.0.42 () {60 vars in 1289 bytes} [Mon Oct 24 13:17:55 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528/ips => generated 152 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:17:55.694421 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-489c9598-2dce-4afe-8c47-e5bed0a18c92 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:55.696816 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-489c9598-2dce-4afe-8c47-e5bed0a18c92 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:55.702852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-489c9598-2dce-4afe-8c47-e5bed0a18c92 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:55.703490 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-489c9598-2dce-4afe-8c47-e5bed0a18c92 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:55.704642 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-489c9598-2dce-4afe-8c47-e5bed0a18c92 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:55.704867 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-489c9598-2dce-4afe-8c47-e5bed0a18c92 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:55.705421 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-489c9598-2dce-4afe-8c47-e5bed0a18c92 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:55.705945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-489c9598-2dce-4afe-8c47-e5bed0a18c92 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:55.735519 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-50996b13-d7ba-4326-8c35-211089a0f29c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:55.738283 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-489c9598-2dce-4afe-8c47-e5bed0a18c92 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048084 Oct 24 13:17:55.739030 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 369/717] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:17:55 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 24 13:17:55.743644 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-48351cac-6fa0-458c-9c3f-bd7e591ee2af tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:55.744260 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-48351cac-6fa0-458c-9c3f-bd7e591ee2af tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:55.746954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-50996b13-d7ba-4326-8c35-211089a0f29c tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.168686 Oct 24 13:17:55.748166 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 349/718] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:55 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:55.750468 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-48351cac-6fa0-458c-9c3f-bd7e591ee2af tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:55.751085 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-48351cac-6fa0-458c-9c3f-bd7e591ee2af tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:55.751703 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-48351cac-6fa0-458c-9c3f-bd7e591ee2af tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:55.752966 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-48351cac-6fa0-458c-9c3f-bd7e591ee2af tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:55.753520 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-48351cac-6fa0-458c-9c3f-bd7e591ee2af tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:55.754040 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-48351cac-6fa0-458c-9c3f-bd7e591ee2af tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:55.814295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-4f741929-e1b1-433b-a917-70195241e4e3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:55.814977 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-4f741929-e1b1-433b-a917-70195241e4e3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:55.822213 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4f741929-e1b1-433b-a917-70195241e4e3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:55.822783 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4f741929-e1b1-433b-a917-70195241e4e3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:55.823350 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4f741929-e1b1-433b-a917-70195241e4e3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:55.824111 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4f741929-e1b1-433b-a917-70195241e4e3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:55.824697 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4f741929-e1b1-433b-a917-70195241e4e3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:55.825163 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4f741929-e1b1-433b-a917-70195241e4e3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:55.855311 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-4f741929-e1b1-433b-a917-70195241e4e3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Going to try to terminate instance {{(pid=118915) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:17:55.918148 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-48351cac-6fa0-458c-9c3f-bd7e591ee2af tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:55.923384 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:55.929767 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-48351cac-6fa0-458c-9c3f-bd7e591ee2af tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e" status: 200 len: 1366 microversion: 2.1 time: 0.189730 Oct 24 13:17:55.947353 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-4f741929-e1b1-433b-a917-70195241e4e3 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "DELETE /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 204 len: 0 microversion: 2.1 time: 0.130656 Oct 24 13:17:55.947353 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 350/719] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:17:55 2022] DELETE /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 13:17:55.948127 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 370/720] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:55 2022] GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:55.951636 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-96a11370-ad40-4b43-8d85-9a6a393ea745 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:55.952311 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-96a11370-ad40-4b43-8d85-9a6a393ea745 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:55.960990 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-96a11370-ad40-4b43-8d85-9a6a393ea745 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:55.961580 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-96a11370-ad40-4b43-8d85-9a6a393ea745 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:55.962026 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-96a11370-ad40-4b43-8d85-9a6a393ea745 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:55.963102 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-96a11370-ad40-4b43-8d85-9a6a393ea745 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:55.963209 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-96a11370-ad40-4b43-8d85-9a6a393ea745 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:55.963644 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-96a11370-ad40-4b43-8d85-9a6a393ea745 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:56.107216 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-96a11370-ad40-4b43-8d85-9a6a393ea745 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:56.114901 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-96a11370-ad40-4b43-8d85-9a6a393ea745 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1673 microversion: 2.1 time: 0.167686 Oct 24 13:17:56.115601 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 351/721] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:55 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:56.774527 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-4024d720-75bd-453e-9398-5a69129678bb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:56.775160 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-4024d720-75bd-453e-9398-5a69129678bb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:56.782912 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4024d720-75bd-453e-9398-5a69129678bb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:56.783414 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4024d720-75bd-453e-9398-5a69129678bb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:56.783846 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4024d720-75bd-453e-9398-5a69129678bb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:56.784527 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4024d720-75bd-453e-9398-5a69129678bb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:56.784978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4024d720-75bd-453e-9398-5a69129678bb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:56.785396 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4024d720-75bd-453e-9398-5a69129678bb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:56.914598 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-4024d720-75bd-453e-9398-5a69129678bb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:56.922158 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-4024d720-75bd-453e-9398-5a69129678bb tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.151687 Oct 24 13:17:56.922723 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 371/722] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:56 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:56.954792 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-28884528-6675-40d6-ac4a-a1078f286641 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:56.955458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-28884528-6675-40d6-ac4a-a1078f286641 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:56.962372 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-28884528-6675-40d6-ac4a-a1078f286641 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:56.962848 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-28884528-6675-40d6-ac4a-a1078f286641 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:56.963318 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-28884528-6675-40d6-ac4a-a1078f286641 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:56.964002 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-28884528-6675-40d6-ac4a-a1078f286641 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:56.964458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-28884528-6675-40d6-ac4a-a1078f286641 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:56.964879 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-28884528-6675-40d6-ac4a-a1078f286641 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:57.094401 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-28884528-6675-40d6-ac4a-a1078f286641 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:57.102634 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-28884528-6675-40d6-ac4a-a1078f286641 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e" status: 200 len: 1366 microversion: 2.1 time: 0.151640 Oct 24 13:17:57.103249 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 352/723] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:56 2022] GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:57.139603 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-16750e2f-f0f4-4cd3-aadd-002d65255f26 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:57.140240 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-16750e2f-f0f4-4cd3-aadd-002d65255f26 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:57.146044 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-16750e2f-f0f4-4cd3-aadd-002d65255f26 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:57.147636 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-16750e2f-f0f4-4cd3-aadd-002d65255f26 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:57.148068 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-16750e2f-f0f4-4cd3-aadd-002d65255f26 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:57.148749 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-16750e2f-f0f4-4cd3-aadd-002d65255f26 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:57.149200 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-16750e2f-f0f4-4cd3-aadd-002d65255f26 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:57.149617 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-16750e2f-f0f4-4cd3-aadd-002d65255f26 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:57.275980 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-16750e2f-f0f4-4cd3-aadd-002d65255f26 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:57.283734 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-16750e2f-f0f4-4cd3-aadd-002d65255f26 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1673 microversion: 2.1 time: 0.148140 Oct 24 13:17:57.284242 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 372/724] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:57 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:57.709707 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-ee2c96ad-6359-4277-a089-e73d3df3fe42 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:17:57.710284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-ee2c96ad-6359-4277-a089-e73d3df3fe42 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:57.716237 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ee2c96ad-6359-4277-a089-e73d3df3fe42 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:57.716724 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ee2c96ad-6359-4277-a089-e73d3df3fe42 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:57.717162 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ee2c96ad-6359-4277-a089-e73d3df3fe42 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:57.717884 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ee2c96ad-6359-4277-a089-e73d3df3fe42 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:57.718370 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ee2c96ad-6359-4277-a089-e73d3df3fe42 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:57.718797 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ee2c96ad-6359-4277-a089-e73d3df3fe42 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:57.721264 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:57.743583 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.objects.instance [None req-ee2c96ad-6359-4277-a089-e73d3df3fe42 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lazy-loading 'flavor' on Instance uuid 54a71380-34c3-40b5-a376-1622f1e44528 {{(pid=118915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:17:57.925226 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-ee2c96ad-6359-4277-a089-e73d3df3fe42 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "POST /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528/action" status: 202 len: 0 microversion: 2.20 time: 0.219828 Oct 24 13:17:57.925849 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 353/725] 10.222.0.42 () {62 vars in 1319 bytes} [Mon Oct 24 13:17:57 2022] POST /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:17:57.934270 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-635f7f46-b949-4708-832e-cde758292794 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:57.934878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-635f7f46-b949-4708-832e-cde758292794 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:57.941480 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-635f7f46-b949-4708-832e-cde758292794 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:57.941953 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-635f7f46-b949-4708-832e-cde758292794 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:57.942378 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-635f7f46-b949-4708-832e-cde758292794 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:57.943220 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-635f7f46-b949-4708-832e-cde758292794 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:57.943927 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-635f7f46-b949-4708-832e-cde758292794 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:57.944346 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-635f7f46-b949-4708-832e-cde758292794 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:57.945692 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8c6525b2-ec56-404f-a99c-3372403eadbd tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:57.946391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-8c6525b2-ec56-404f-a99c-3372403eadbd tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:57.952507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8c6525b2-ec56-404f-a99c-3372403eadbd tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:57.952986 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8c6525b2-ec56-404f-a99c-3372403eadbd tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:57.953425 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8c6525b2-ec56-404f-a99c-3372403eadbd tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:57.954120 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8c6525b2-ec56-404f-a99c-3372403eadbd tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:57.954579 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8c6525b2-ec56-404f-a99c-3372403eadbd tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:57.955002 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8c6525b2-ec56-404f-a99c-3372403eadbd tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:58.084302 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-635f7f46-b949-4708-832e-cde758292794 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:58.092745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-635f7f46-b949-4708-832e-cde758292794 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:58.093897 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-8c6525b2-ec56-404f-a99c-3372403eadbd tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:58.094178 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-635f7f46-b949-4708-832e-cde758292794 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:58.095371 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-635f7f46-b949-4708-832e-cde758292794 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1723 microversion: 2.20 time: 0.164941 Oct 24 13:17:58.095939 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 373/726] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:17:57 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:17:58.101877 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-8c6525b2-ec56-404f-a99c-3372403eadbd tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.160224 Oct 24 13:17:58.102442 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 354/727] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:57 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:17:58.124640 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-068694cc-aed1-4361-a593-c4405e3ccf8b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:58.125248 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-068694cc-aed1-4361-a593-c4405e3ccf8b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:58.127025 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:17:58.132615 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-068694cc-aed1-4361-a593-c4405e3ccf8b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:58.133093 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-068694cc-aed1-4361-a593-c4405e3ccf8b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:58.133527 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-068694cc-aed1-4361-a593-c4405e3ccf8b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:58.134207 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-068694cc-aed1-4361-a593-c4405e3ccf8b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:58.134663 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-068694cc-aed1-4361-a593-c4405e3ccf8b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:58.135108 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-068694cc-aed1-4361-a593-c4405e3ccf8b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:58.264800 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-068694cc-aed1-4361-a593-c4405e3ccf8b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:58.272961 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-068694cc-aed1-4361-a593-c4405e3ccf8b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e" status: 200 len: 1366 microversion: 2.1 time: 0.151925 Oct 24 13:17:58.273517 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 374/728] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:58 2022] GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:58.308105 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-539a52aa-c0a1-4ca3-a1b2-1e42a5cfbbba tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:58.308715 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-539a52aa-c0a1-4ca3-a1b2-1e42a5cfbbba tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:58.314688 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-539a52aa-c0a1-4ca3-a1b2-1e42a5cfbbba tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:58.315201 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-539a52aa-c0a1-4ca3-a1b2-1e42a5cfbbba tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:58.315655 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-539a52aa-c0a1-4ca3-a1b2-1e42a5cfbbba tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:58.316339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-539a52aa-c0a1-4ca3-a1b2-1e42a5cfbbba tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:58.316791 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-539a52aa-c0a1-4ca3-a1b2-1e42a5cfbbba tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:58.317212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-539a52aa-c0a1-4ca3-a1b2-1e42a5cfbbba tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:58.448134 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-539a52aa-c0a1-4ca3-a1b2-1e42a5cfbbba tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:58.455818 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-539a52aa-c0a1-4ca3-a1b2-1e42a5cfbbba tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1673 microversion: 2.1 time: 0.151587 Oct 24 13:17:58.456376 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 355/729] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:58 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:59.120327 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-cf0389c2-a806-41c9-9890-d40c814973ff tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:59.120944 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-cf0389c2-a806-41c9-9890-d40c814973ff tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:59.124472 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-f4e7f518-e420-46af-a6f7-f0d45427c61d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:59.125097 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-f4e7f518-e420-46af-a6f7-f0d45427c61d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:59.127360 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cf0389c2-a806-41c9-9890-d40c814973ff tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:59.127846 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cf0389c2-a806-41c9-9890-d40c814973ff tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:59.128284 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cf0389c2-a806-41c9-9890-d40c814973ff tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:59.128974 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cf0389c2-a806-41c9-9890-d40c814973ff tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:59.129426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cf0389c2-a806-41c9-9890-d40c814973ff tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:59.129849 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cf0389c2-a806-41c9-9890-d40c814973ff tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:59.132167 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f4e7f518-e420-46af-a6f7-f0d45427c61d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:59.132649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f4e7f518-e420-46af-a6f7-f0d45427c61d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:59.133087 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f4e7f518-e420-46af-a6f7-f0d45427c61d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:59.133788 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f4e7f518-e420-46af-a6f7-f0d45427c61d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:59.134245 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f4e7f518-e420-46af-a6f7-f0d45427c61d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:59.134673 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f4e7f518-e420-46af-a6f7-f0d45427c61d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:59.266528 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-f4e7f518-e420-46af-a6f7-f0d45427c61d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:59.275007 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-f4e7f518-e420-46af-a6f7-f0d45427c61d tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1522 microversion: 2.1 time: 0.154407 Oct 24 13:17:59.275823 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 356/730] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:59 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:17:59.297320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-b134ec13-cf5c-460b-94b2-95310d91bd5b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:59.298344 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-b134ec13-cf5c-460b-94b2-95310d91bd5b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:59.306935 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b134ec13-cf5c-460b-94b2-95310d91bd5b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:59.307999 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b134ec13-cf5c-460b-94b2-95310d91bd5b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:59.308511 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b134ec13-cf5c-460b-94b2-95310d91bd5b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:59.309262 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b134ec13-cf5c-460b-94b2-95310d91bd5b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:59.309719 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b134ec13-cf5c-460b-94b2-95310d91bd5b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:59.310289 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b134ec13-cf5c-460b-94b2-95310d91bd5b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:59.341686 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-cf0389c2-a806-41c9-9890-d40c814973ff tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:59.350962 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-cf0389c2-a806-41c9-9890-d40c814973ff tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:59.352569 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-cf0389c2-a806-41c9-9890-d40c814973ff tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:59.353785 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-cf0389c2-a806-41c9-9890-d40c814973ff tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1723 microversion: 2.20 time: 0.237429 Oct 24 13:17:59.354345 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 375/731] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:17:59 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:17:59.447321 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-b134ec13-cf5c-460b-94b2-95310d91bd5b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:59.454876 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-b134ec13-cf5c-460b-94b2-95310d91bd5b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e" status: 200 len: 1366 microversion: 2.1 time: 0.162417 Oct 24 13:17:59.455538 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 357/732] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:59 2022] GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:17:59.479397 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-87752bb6-6604-489c-aad0-4ca1c0fb0351 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:17:59.480175 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-87752bb6-6604-489c-aad0-4ca1c0fb0351 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:17:59.486937 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-87752bb6-6604-489c-aad0-4ca1c0fb0351 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:59.487586 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-87752bb6-6604-489c-aad0-4ca1c0fb0351 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:59.488113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-87752bb6-6604-489c-aad0-4ca1c0fb0351 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:59.488967 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-87752bb6-6604-489c-aad0-4ca1c0fb0351 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:17:59.489516 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-87752bb6-6604-489c-aad0-4ca1c0fb0351 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:17:59.490746 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-87752bb6-6604-489c-aad0-4ca1c0fb0351 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:17:59.657386 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-87752bb6-6604-489c-aad0-4ca1c0fb0351 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:17:59.665692 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-87752bb6-6604-489c-aad0-4ca1c0fb0351 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1673 microversion: 2.1 time: 0.190023 Oct 24 13:17:59.666258 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 376/733] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:17:59 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1673 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:18:00.298820 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-5d998c2a-2901-482e-8e44-fa999e90f478 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:00.299488 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-5d998c2a-2901-482e-8e44-fa999e90f478 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:00.301437 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=2 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:00.302126 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=6 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:00.314458 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=6 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:00.318890 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5d998c2a-2901-482e-8e44-fa999e90f478 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:00.320127 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5d998c2a-2901-482e-8e44-fa999e90f478 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:00.320577 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5d998c2a-2901-482e-8e44-fa999e90f478 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:00.321304 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5d998c2a-2901-482e-8e44-fa999e90f478 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:00.321765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5d998c2a-2901-482e-8e44-fa999e90f478 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:00.322376 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5d998c2a-2901-482e-8e44-fa999e90f478 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:00.371932 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-d7806b6e-0424-4c67-8dac-dd8176d40dbb req-9b459b49-1954-4d1b-a138-add1adb1999e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2011f5ea-73ab-457d-be16-25ad031e5e96", "name": "network-vif-deleted", "tag": "1acef793-2d20-4fbe-8204-9955726c8836"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:00.382216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-d7806b6e-0424-4c67-8dac-dd8176d40dbb req-9b459b49-1954-4d1b-a138-add1adb1999e service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:00.382694 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-d7806b6e-0424-4c67-8dac-dd8176d40dbb req-9b459b49-1954-4d1b-a138-add1adb1999e service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:00.383230 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-d7806b6e-0424-4c67-8dac-dd8176d40dbb req-9b459b49-1954-4d1b-a138-add1adb1999e service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:00.394457 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-d7806b6e-0424-4c67-8dac-dd8176d40dbb req-9b459b49-1954-4d1b-a138-add1adb1999e service nova] Creating event network-vif-deleted:1acef793-2d20-4fbe-8204-9955726c8836 for instance 2011f5ea-73ab-457d-be16-25ad031e5e96 on hv-cinder-86248 Oct 24 13:18:00.401367 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-d7806b6e-0424-4c67-8dac-dd8176d40dbb req-9b459b49-1954-4d1b-a138-add1adb1999e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091659 Oct 24 13:18:00.402036 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 377/734] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:00.407313 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-465900b0-0d01-46c1-96ba-052e26993b7a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:00.408051 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-465900b0-0d01-46c1-96ba-052e26993b7a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:00.415468 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-465900b0-0d01-46c1-96ba-052e26993b7a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:00.415965 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-465900b0-0d01-46c1-96ba-052e26993b7a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:00.416403 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-465900b0-0d01-46c1-96ba-052e26993b7a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:00.417110 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-465900b0-0d01-46c1-96ba-052e26993b7a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:00.417591 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-465900b0-0d01-46c1-96ba-052e26993b7a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:00.418018 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-465900b0-0d01-46c1-96ba-052e26993b7a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:00.429099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-5d998c2a-2901-482e-8e44-fa999e90f478 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd29ff25b062346f6bcf9910b1fa8db5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85d62dec32104e7b8c595953a479026b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:00.441144 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-5d998c2a-2901-482e-8e44-fa999e90f478 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 200 len: 1480 microversion: 2.1 time: 0.146260 Oct 24 13:18:00.458110 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 358/735] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:00 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 1480 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:00.479662 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-4edfb1fa-2160-4710-94ee-942504ebd8e5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:00.480601 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-4edfb1fa-2160-4710-94ee-942504ebd8e5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:00.500726 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4edfb1fa-2160-4710-94ee-942504ebd8e5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:00.501219 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4edfb1fa-2160-4710-94ee-942504ebd8e5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:00.501663 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4edfb1fa-2160-4710-94ee-942504ebd8e5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:00.502373 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4edfb1fa-2160-4710-94ee-942504ebd8e5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:00.502831 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4edfb1fa-2160-4710-94ee-942504ebd8e5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:00.503301 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4edfb1fa-2160-4710-94ee-942504ebd8e5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:00.604761 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-465900b0-0d01-46c1-96ba-052e26993b7a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:00.613941 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-465900b0-0d01-46c1-96ba-052e26993b7a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:00.616782 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-465900b0-0d01-46c1-96ba-052e26993b7a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:00.618338 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-465900b0-0d01-46c1-96ba-052e26993b7a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1723 microversion: 2.20 time: 0.215076 Oct 24 13:18:00.619445 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 378/736] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:00 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:00.689945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-985ed1cc-00f0-4ff8-879b-d1c2479d6f57 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:00.690797 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-985ed1cc-00f0-4ff8-879b-d1c2479d6f57 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:00.704131 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-985ed1cc-00f0-4ff8-879b-d1c2479d6f57 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:00.704778 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-985ed1cc-00f0-4ff8-879b-d1c2479d6f57 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:00.705221 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-985ed1cc-00f0-4ff8-879b-d1c2479d6f57 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:00.705935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-985ed1cc-00f0-4ff8-879b-d1c2479d6f57 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:00.706592 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-985ed1cc-00f0-4ff8-879b-d1c2479d6f57 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:00.707208 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-985ed1cc-00f0-4ff8-879b-d1c2479d6f57 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:00.787275 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-985ed1cc-00f0-4ff8-879b-d1c2479d6f57 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:00.798161 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-985ed1cc-00f0-4ff8-879b-d1c2479d6f57 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1605 microversion: 2.1 time: 0.111418 Oct 24 13:18:00.799949 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 379/737] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:00 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1605 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:18:00.998518 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-4edfb1fa-2160-4710-94ee-942504ebd8e5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:01.006891 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-4edfb1fa-2160-4710-94ee-942504ebd8e5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e" status: 200 len: 1366 microversion: 2.1 time: 0.532692 Oct 24 13:18:01.007550 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 359/738] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:00 2022] GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e => generated 1366 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:18:01.466031 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-9c8b7503-737c-4113-9dc9-401b6fe9b575 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:01.466643 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-9c8b7503-737c-4113-9dc9-401b6fe9b575 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] [instance: 2011f5ea-73ab-457d-be16-25ad031e5e96] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:01.472993 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9c8b7503-737c-4113-9dc9-401b6fe9b575 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:01.473526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9c8b7503-737c-4113-9dc9-401b6fe9b575 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:01.473963 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9c8b7503-737c-4113-9dc9-401b6fe9b575 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:01.475315 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9c8b7503-737c-4113-9dc9-401b6fe9b575 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:01.475783 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9c8b7503-737c-4113-9dc9-401b6fe9b575 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:01.476221 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9c8b7503-737c-4113-9dc9-401b6fe9b575 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:01.489667 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-9c8b7503-737c-4113-9dc9-401b6fe9b575 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] HTTP exception thrown: Instance 2011f5ea-73ab-457d-be16-25ad031e5e96 could not be found. Oct 24 13:18:01.491400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-9c8b7503-737c-4113-9dc9-401b6fe9b575 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Request method failure captured: Oct 24 13:18:01.491400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 HTTP/1.1 Oct 24 13:18:01.491400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:18:01.491400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:18:01.491400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:18:01.491400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:18:01.491400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:18:01.491400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:18:01.491400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:18:01.491400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:18:01.491400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVo8-MVUZt3eqKP9axHhN9-YGEl3TZduwFjpEinzp6vl_5EPjxspkm0YjnuEeX52n_zMOBC2DHbIvahT4eFkJ4bpeh_VkPLMHqyH0kf3GvMdexv9ZvJHWuw2mGfp1Tv9L3Xia6cV13F533nQVQsLnKzwUhe5Mqd9rFhScRAi468eY_Qw Oct 24 13:18:01.491400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:18:01.491400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:18:01.491400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:18:01.491400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:18:01.491400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:18:01.491400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:18:01.491400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: 85d62dec32104e7b8c595953a479026b Oct 24 13:18:01.491400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2008376724 Oct 24 13:18:01.491400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:18:01.491400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:18:01.492694 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/85d62dec32104e7b8c595953a479026b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/85d62dec32104e7b8c595953a479026b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/85d62dec32104e7b8c595953a479026b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_85d62dec32104e7b8c595953a479026b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:18:01.492694 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2008376724 Oct 24 13:18:01.492694 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: 85d62dec32104e7b8c595953a479026b Oct 24 13:18:01.492694 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2008376724 Oct 24 13:18:01.492694 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-ServerRescueNegativeTestJSON-2008376724-project Oct 24 13:18:01.492694 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:18:01.492694 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:18:01.492694 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: d29ff25b062346f6bcf9910b1fa8db5c Oct 24 13:18:01.492694 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2008376724-project Oct 24 13:18:01.492694 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:18:01.492694 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Instance 2011f5ea-73ab-457d-be16-25ad031e5e96 could not be found. Oct 24 13:18:01.492694 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': '2011f5ea-73ab-457d-be16-25ad031e5e96'} Oct 24 13:18:01.493426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:18:01.493426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:18:01.493426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:18:01.493426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:18:01.493426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:18:01.493426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:18:01.493426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:18:01.493426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:18:01.493426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:18:01.493426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:18:01.493426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2011f5ea-73ab-457d-be16-25ad031e5e96 could not be found. Oct 24 13:18:01.493426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:18:01.493426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:18:01.493426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:18:01.493426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:18:01.493426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:18:01.493426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:18:01.493426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:18:01.493426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:18:01.493426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:18:01.494629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:18:01.494629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:18:01.494629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:18:01.494629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:18:01.494629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:18:01.494629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:18:01.494629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:18:01.494629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2011f5ea-73ab-457d-be16-25ad031e5e96 could not be found. Oct 24 13:18:01.494629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:18:01.494629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:18:01.494629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:18:01.494629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:18:01.494629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:18:01.494629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:18:01.494629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:18:01.494629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:18:01.494629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2011f5ea-73ab-457d-be16-25ad031e5e96 could not be found. Oct 24 13:18:01.494629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:18:01.495767 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-9c8b7503-737c-4113-9dc9-401b6fe9b575 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] Returning 404 to user: Instance 2011f5ea-73ab-457d-be16-25ad031e5e96 could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:18:01.495767 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-9c8b7503-737c-4113-9dc9-401b6fe9b575 tempest-ServerRescueNegativeTestJSON-2008376724 tempest-ServerRescueNegativeTestJSON-2008376724-project] 10.222.0.42 "GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96" status: 404 len: 111 microversion: 2.1 time: 0.030706 Oct 24 13:18:01.495767 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 380/739] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:01 2022] GET /compute/v2.1/servers/2011f5ea-73ab-457d-be16-25ad031e5e96 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:18:01.646472 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-853e6730-5ab9-4c5a-9304-1c805afd8335 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:01.647310 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-853e6730-5ab9-4c5a-9304-1c805afd8335 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:01.654607 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-853e6730-5ab9-4c5a-9304-1c805afd8335 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:01.655127 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-853e6730-5ab9-4c5a-9304-1c805afd8335 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:01.655825 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-853e6730-5ab9-4c5a-9304-1c805afd8335 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:01.656756 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-853e6730-5ab9-4c5a-9304-1c805afd8335 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:01.657132 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-853e6730-5ab9-4c5a-9304-1c805afd8335 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:01.657564 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-853e6730-5ab9-4c5a-9304-1c805afd8335 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:01.825170 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-6c5a571d-5faa-482f-934d-40164bfc13c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:01.826176 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-6c5a571d-5faa-482f-934d-40164bfc13c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:01.850902 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6c5a571d-5faa-482f-934d-40164bfc13c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:01.851927 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6c5a571d-5faa-482f-934d-40164bfc13c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:01.852601 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6c5a571d-5faa-482f-934d-40164bfc13c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:01.853613 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6c5a571d-5faa-482f-934d-40164bfc13c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:01.855594 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6c5a571d-5faa-482f-934d-40164bfc13c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:01.856272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6c5a571d-5faa-482f-934d-40164bfc13c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:01.875958 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-853e6730-5ab9-4c5a-9304-1c805afd8335 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:01.888117 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-853e6730-5ab9-4c5a-9304-1c805afd8335 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:01.889478 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-853e6730-5ab9-4c5a-9304-1c805afd8335 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:01.892392 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-853e6730-5ab9-4c5a-9304-1c805afd8335 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1723 microversion: 2.20 time: 0.250707 Oct 24 13:18:01.893175 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 360/740] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:01 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:01.937919 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6c5a571d-5faa-482f-934d-40164bfc13c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:01.938861 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6c5a571d-5faa-482f-934d-40164bfc13c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:01.939521 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6c5a571d-5faa-482f-934d-40164bfc13c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:01.941566 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.objects.instance [None req-6c5a571d-5faa-482f-934d-40164bfc13c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lazy-loading 'fault' on Instance uuid 29f8f878-fe8d-4dd0-9478-268c08885faf {{(pid=118914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:18:02.033004 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-6c5a571d-5faa-482f-934d-40164bfc13c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:02.038424 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-71b57a75-e1de-49f6-b7ee-1e73814b5770 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:02.039592 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-71b57a75-e1de-49f6-b7ee-1e73814b5770 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:02.055213 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-71b57a75-e1de-49f6-b7ee-1e73814b5770 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:02.056177 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-6c5a571d-5faa-482f-934d-40164bfc13c1 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 200 len: 1326 microversion: 2.1 time: 0.234874 Oct 24 13:18:02.072919 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-71b57a75-e1de-49f6-b7ee-1e73814b5770 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:02.073683 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 381/741] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:01 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 1326 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:18:02.073810 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-71b57a75-e1de-49f6-b7ee-1e73814b5770 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:02.074622 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-71b57a75-e1de-49f6-b7ee-1e73814b5770 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:02.075122 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-71b57a75-e1de-49f6-b7ee-1e73814b5770 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:02.075553 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-71b57a75-e1de-49f6-b7ee-1e73814b5770 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:02.240219 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-71b57a75-e1de-49f6-b7ee-1e73814b5770 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:02.248428 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-71b57a75-e1de-49f6-b7ee-1e73814b5770 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e" status: 200 len: 1366 microversion: 2.1 time: 0.219185 Oct 24 13:18:02.249208 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 361/742] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:02 2022] GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:18:02.432141 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-5166ed5b-0067-49d3-933d-d6fac620fd64 req-f3fc8ee3-e1da-4807-a26d-b0bb8d31d2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29f8f878-fe8d-4dd0-9478-268c08885faf", "name": "network-vif-deleted", "tag": "693064f5-7b97-41dc-8a3f-8c6ce5d17036"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:02.442038 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-5166ed5b-0067-49d3-933d-d6fac620fd64 req-f3fc8ee3-e1da-4807-a26d-b0bb8d31d2c0 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:02.442832 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-5166ed5b-0067-49d3-933d-d6fac620fd64 req-f3fc8ee3-e1da-4807-a26d-b0bb8d31d2c0 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:02.443299 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-5166ed5b-0067-49d3-933d-d6fac620fd64 req-f3fc8ee3-e1da-4807-a26d-b0bb8d31d2c0 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:02.456478 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-5166ed5b-0067-49d3-933d-d6fac620fd64 req-f3fc8ee3-e1da-4807-a26d-b0bb8d31d2c0 service nova] Creating event network-vif-deleted:693064f5-7b97-41dc-8a3f-8c6ce5d17036 for instance 29f8f878-fe8d-4dd0-9478-268c08885faf on hv-cinder-86248 Oct 24 13:18:02.462098 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-5166ed5b-0067-49d3-933d-d6fac620fd64 req-f3fc8ee3-e1da-4807-a26d-b0bb8d31d2c0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033514 Oct 24 13:18:02.462847 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 382/743] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:18:02.921102 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-57c46329-2b61-4663-9e68-6e6cb8afa391 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:02.921849 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-57c46329-2b61-4663-9e68-6e6cb8afa391 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:02.929374 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-57c46329-2b61-4663-9e68-6e6cb8afa391 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:02.929864 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-57c46329-2b61-4663-9e68-6e6cb8afa391 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:02.930302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-57c46329-2b61-4663-9e68-6e6cb8afa391 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:02.931194 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-57c46329-2b61-4663-9e68-6e6cb8afa391 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:02.931656 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-57c46329-2b61-4663-9e68-6e6cb8afa391 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:02.932223 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-57c46329-2b61-4663-9e68-6e6cb8afa391 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:03.078117 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-57c46329-2b61-4663-9e68-6e6cb8afa391 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:03.087125 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-fee50325-0091-408d-9f4f-9e4e1499c83b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:03.087843 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-fee50325-0091-408d-9f4f-9e4e1499c83b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:03.096853 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fee50325-0091-408d-9f4f-9e4e1499c83b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:03.097148 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-57c46329-2b61-4663-9e68-6e6cb8afa391 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:03.097793 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fee50325-0091-408d-9f4f-9e4e1499c83b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:03.098417 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fee50325-0091-408d-9f4f-9e4e1499c83b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:03.098880 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-57c46329-2b61-4663-9e68-6e6cb8afa391 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:03.100424 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fee50325-0091-408d-9f4f-9e4e1499c83b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:03.100785 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-57c46329-2b61-4663-9e68-6e6cb8afa391 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1723 microversion: 2.20 time: 0.183751 Oct 24 13:18:03.101252 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fee50325-0091-408d-9f4f-9e4e1499c83b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:03.101763 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 362/744] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:02 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:03.107292 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fee50325-0091-408d-9f4f-9e4e1499c83b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:03.127199 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-fee50325-0091-408d-9f4f-9e4e1499c83b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] HTTP exception thrown: Instance 29f8f878-fe8d-4dd0-9478-268c08885faf could not be found. Oct 24 13:18:03.129113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-fee50325-0091-408d-9f4f-9e4e1499c83b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Request method failure captured: Oct 24 13:18:03.129113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf HTTP/1.1 Oct 24 13:18:03.129113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:18:03.129113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:18:03.129113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:18:03.129113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:18:03.129113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:18:03.129113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:18:03.129113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:18:03.129113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:18:03.129113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVo-GeR-HXjzW-cLwol3MKpeZg9RjVRbhk6vm97zhGoa7ad-OV1f3Sk_SoBtQ5944X1NmnRtyI5SC1EsKICVzBJZdAynivxtGpKIUY7eq_X7YV1Xp1STj1hqtApKA5WO_jW0Zdojq4uejhJH9CiEfd_kndYYa1eA1IWj7f23R3KHx08I Oct 24 13:18:03.129113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:18:03.129113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:18:03.129113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:18:03.129113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:18:03.129113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:18:03.129113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:18:03.129113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: df0bdf3ab29d43e0bf749b9814813e5c Oct 24 13:18:03.129113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-AttachVolumeTestJSON-1191960355 Oct 24 13:18:03.129113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:18:03.129113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:18:03.131636 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:18:03.131636 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-AttachVolumeTestJSON-1191960355 Oct 24 13:18:03.131636 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: df0bdf3ab29d43e0bf749b9814813e5c Oct 24 13:18:03.131636 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1191960355 Oct 24 13:18:03.131636 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-AttachVolumeTestJSON-1191960355-project Oct 24 13:18:03.131636 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:18:03.131636 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:18:03.131636 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: 3f69df43e6ca4663a9ef819c0331c13d Oct 24 13:18:03.131636 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-AttachVolumeTestJSON-1191960355-project Oct 24 13:18:03.131636 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:18:03.131636 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Instance 29f8f878-fe8d-4dd0-9478-268c08885faf could not be found. Oct 24 13:18:03.131636 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': '29f8f878-fe8d-4dd0-9478-268c08885faf'} Oct 24 13:18:03.132701 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:18:03.132701 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:18:03.132701 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:18:03.132701 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:18:03.132701 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:18:03.132701 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:18:03.132701 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:18:03.132701 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:18:03.132701 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:18:03.132701 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:18:03.132701 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29f8f878-fe8d-4dd0-9478-268c08885faf could not be found. Oct 24 13:18:03.132701 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:18:03.132701 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:18:03.132701 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:18:03.132701 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:18:03.132701 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:18:03.132701 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:18:03.132701 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:18:03.132701 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:18:03.132701 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:18:03.134151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:18:03.134151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:18:03.134151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:18:03.134151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:18:03.134151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:18:03.134151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:18:03.134151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:18:03.134151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29f8f878-fe8d-4dd0-9478-268c08885faf could not be found. Oct 24 13:18:03.134151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:18:03.134151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:18:03.134151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:18:03.134151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:18:03.134151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:18:03.134151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:18:03.134151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:18:03.134151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:18:03.134151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29f8f878-fe8d-4dd0-9478-268c08885faf could not be found. Oct 24 13:18:03.134151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:18:03.137068 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-fee50325-0091-408d-9f4f-9e4e1499c83b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Returning 404 to user: Instance 29f8f878-fe8d-4dd0-9478-268c08885faf could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:18:03.138102 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-fee50325-0091-408d-9f4f-9e4e1499c83b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 404 len: 111 microversion: 2.1 time: 0.056126 Oct 24 13:18:03.140123 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 383/745] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:03 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:18:03.147925 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-45441668-5f8c-4e31-a14c-c680aba77421 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '.version_select at 0x7fad284a6b80>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:03.169520 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-45441668-5f8c-4e31-a14c-c680aba77421 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-849369560" status: 202 len: 0 microversion: 2.1 time: 0.025612 Oct 24 13:18:03.170481 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 363/746] 10.222.0.42 () {58 vars in 1218 bytes} [Mon Oct 24 13:18:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-849369560 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:18:03.272535 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-4b25bf89-e777-4b47-94f2-2eec040c6dd7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:03.273094 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-4b25bf89-e777-4b47-94f2-2eec040c6dd7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:03.279752 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4b25bf89-e777-4b47-94f2-2eec040c6dd7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:03.280620 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4b25bf89-e777-4b47-94f2-2eec040c6dd7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:03.281348 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4b25bf89-e777-4b47-94f2-2eec040c6dd7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:03.282476 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4b25bf89-e777-4b47-94f2-2eec040c6dd7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:03.283130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4b25bf89-e777-4b47-94f2-2eec040c6dd7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:03.283715 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4b25bf89-e777-4b47-94f2-2eec040c6dd7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:03.798246 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-4b25bf89-e777-4b47-94f2-2eec040c6dd7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:03.810840 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-4b25bf89-e777-4b47-94f2-2eec040c6dd7 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e" status: 200 len: 1366 microversion: 2.1 time: 0.542673 Oct 24 13:18:03.811670 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 384/747] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:03 2022] GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e => generated 1366 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:04.011115 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-1296a8fe-ddcd-4722-9b07-5695fb665a9b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Action: 'create', calling method: .version_select at 0x7fad28317820>, body: {"keypair": {"name": "tempest-keypair-1298102662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmIBsmYfi+e9EZaeSFu/tG/GX5uDwjWfgbVp1+HR3KyLB5UezVShFpFTDWzotpt/kzX3fxMzrvBnd5AL1R4v/eulaDtgHj7CEPPTjmnhraJp1jYBqFBvxu4Z0CYg6X7WQ=="}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:04.048612 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-1296a8fe-ddcd-4722-9b07-5695fb665a9b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Getting quotas for project df0bdf3ab29d43e0bf749b9814813e5c. Resources: {'key_pairs'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:18:04.060085 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-1296a8fe-ddcd-4722-9b07-5695fb665a9b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Getting quotas for user 3f69df43e6ca4663a9ef819c0331c13d and project df0bdf3ab29d43e0bf749b9814813e5c. Resources: {'key_pairs'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:18:04.095357 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:04.104391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-1296a8fe-ddcd-4722-9b07-5695fb665a9b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.098446 Oct 24 13:18:04.106575 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 364/748] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Oct 24 13:18:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:04.124905 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-d1398c1c-5771-4dde-83fa-877e2bb9dc1d req-d978ed86-07f3-4f44-ba36-93a3bc758a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f52b209f-c997-4d1b-9ecf-a4fdc033b64e", "name": "network-vif-plugged", "status": "completed", "tag": "170c174e-102a-43bf-931e-57ccc699cfd2"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:04.147196 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-716fde9a-9ba6-443d-ab39-adf5ab22bd9d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:04.153266 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-716fde9a-9ba6-443d-ab39-adf5ab22bd9d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:04.157293 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-d1398c1c-5771-4dde-83fa-877e2bb9dc1d req-d978ed86-07f3-4f44-ba36-93a3bc758a3d service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:04.157779 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-d1398c1c-5771-4dde-83fa-877e2bb9dc1d req-d978ed86-07f3-4f44-ba36-93a3bc758a3d service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:04.158199 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-d1398c1c-5771-4dde-83fa-877e2bb9dc1d req-d978ed86-07f3-4f44-ba36-93a3bc758a3d service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:04.185247 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-716fde9a-9ba6-443d-ab39-adf5ab22bd9d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:04.187705 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-716fde9a-9ba6-443d-ab39-adf5ab22bd9d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:04.189453 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-716fde9a-9ba6-443d-ab39-adf5ab22bd9d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:04.193640 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-716fde9a-9ba6-443d-ab39-adf5ab22bd9d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:04.194423 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-716fde9a-9ba6-443d-ab39-adf5ab22bd9d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:04.196272 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-716fde9a-9ba6-443d-ab39-adf5ab22bd9d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:04.213791 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-d1398c1c-5771-4dde-83fa-877e2bb9dc1d req-d978ed86-07f3-4f44-ba36-93a3bc758a3d service nova] Creating event network-vif-plugged:170c174e-102a-43bf-931e-57ccc699cfd2 for instance f52b209f-c997-4d1b-9ecf-a4fdc033b64e on hv-cinder-86248 Oct 24 13:18:04.226303 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-d1398c1c-5771-4dde-83fa-877e2bb9dc1d req-d978ed86-07f3-4f44-ba36-93a3bc758a3d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199185 Oct 24 13:18:04.228994 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 385/749] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:04.549865 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-716fde9a-9ba6-443d-ab39-adf5ab22bd9d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:04.559596 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-716fde9a-9ba6-443d-ab39-adf5ab22bd9d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:04.560991 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-716fde9a-9ba6-443d-ab39-adf5ab22bd9d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:04.562172 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-716fde9a-9ba6-443d-ab39-adf5ab22bd9d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1723 microversion: 2.20 time: 0.433706 Oct 24 13:18:04.562913 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 365/750] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:04 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1723 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:04.836006 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c555e010-3dc0-49b1-a949-692f25fc2c0e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:04.837366 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-c555e010-3dc0-49b1-a949-692f25fc2c0e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:04.844858 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c555e010-3dc0-49b1-a949-692f25fc2c0e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:04.845419 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c555e010-3dc0-49b1-a949-692f25fc2c0e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:04.846122 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c555e010-3dc0-49b1-a949-692f25fc2c0e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:04.846917 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c555e010-3dc0-49b1-a949-692f25fc2c0e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:04.847409 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c555e010-3dc0-49b1-a949-692f25fc2c0e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:04.848087 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c555e010-3dc0-49b1-a949-692f25fc2c0e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:05.107982 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-c555e010-3dc0-49b1-a949-692f25fc2c0e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:05.115654 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-c555e010-3dc0-49b1-a949-692f25fc2c0e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e" status: 200 len: 1366 microversion: 2.1 time: 0.285218 Oct 24 13:18:05.116220 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 386/751] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:04 2022] GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:05.355733 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-96d836e4-10f5-4f18-be2d-7d3f3a479fe1 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1521375948"}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:05.356451 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-96d836e4-10f5-4f18-be2d-7d3f3a479fe1 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:05.371952 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-96d836e4-10f5-4f18-be2d-7d3f3a479fe1 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:05.372444 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-96d836e4-10f5-4f18-be2d-7d3f3a479fe1 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:05.374113 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-96d836e4-10f5-4f18-be2d-7d3f3a479fe1 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:05.374831 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-96d836e4-10f5-4f18-be2d-7d3f3a479fe1 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:05.375466 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-96d836e4-10f5-4f18-be2d-7d3f3a479fe1 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:05.375901 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-96d836e4-10f5-4f18-be2d-7d3f3a479fe1 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:05.589899 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-1c431878-cd08-4027-bbdf-7a38c5336827 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:05.590577 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-1c431878-cd08-4027-bbdf-7a38c5336827 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:05.597618 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1c431878-cd08-4027-bbdf-7a38c5336827 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:05.598110 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1c431878-cd08-4027-bbdf-7a38c5336827 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:05.598547 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1c431878-cd08-4027-bbdf-7a38c5336827 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:05.599835 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1c431878-cd08-4027-bbdf-7a38c5336827 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:05.600558 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1c431878-cd08-4027-bbdf-7a38c5336827 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:05.601055 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1c431878-cd08-4027-bbdf-7a38c5336827 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:05.610356 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.network.security_group_api [None req-96d836e4-10f5-4f18-be2d-7d3f3a479fe1 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Removing security group 31fd1301-f176-4b08-b18d-2698cccfa8e3 from port 018f2d3e-909b-488a-af88-b11609f2409d Oct 24 13:18:05.872826 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-1c431878-cd08-4027-bbdf-7a38c5336827 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:05.882646 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-1c431878-cd08-4027-bbdf-7a38c5336827 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:05.884578 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-1c431878-cd08-4027-bbdf-7a38c5336827 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:05.886157 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-1c431878-cd08-4027-bbdf-7a38c5336827 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1723 microversion: 2.20 time: 0.299972 Oct 24 13:18:05.886874 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 387/752] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:05 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:18:06.140503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-ab82b5b3-2298-48b6-b8ac-5af5b998dcec tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:06.141235 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-ab82b5b3-2298-48b6-b8ac-5af5b998dcec tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:06.152299 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ab82b5b3-2298-48b6-b8ac-5af5b998dcec tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:06.154173 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ab82b5b3-2298-48b6-b8ac-5af5b998dcec tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:06.156027 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ab82b5b3-2298-48b6-b8ac-5af5b998dcec tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:06.157552 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ab82b5b3-2298-48b6-b8ac-5af5b998dcec tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:06.158839 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ab82b5b3-2298-48b6-b8ac-5af5b998dcec tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:06.159308 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ab82b5b3-2298-48b6-b8ac-5af5b998dcec tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:06.173526 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-96d836e4-10f5-4f18-be2d-7d3f3a479fe1 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "POST /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4/action" status: 202 len: 0 microversion: 2.1 time: 0.822816 Oct 24 13:18:06.180632 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 366/753] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 24 13:18:05 2022] POST /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4/action => generated 0 bytes in 830 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:18:06.188522 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-71ebc35f-7245-43e3-a184-4e23eb40033b req-33ae38a4-4613-4846-a579-d1bb1c3da29a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5633650-dcf9-49be-b565-3e8fb5a765f4", "tag": "018f2d3e-909b-488a-af88-b11609f2409d"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:06.201919 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-71ebc35f-7245-43e3-a184-4e23eb40033b req-33ae38a4-4613-4846-a579-d1bb1c3da29a service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:06.202861 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-71ebc35f-7245-43e3-a184-4e23eb40033b req-33ae38a4-4613-4846-a579-d1bb1c3da29a service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:06.203482 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-71ebc35f-7245-43e3-a184-4e23eb40033b req-33ae38a4-4613-4846-a579-d1bb1c3da29a service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:06.222762 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-71ebc35f-7245-43e3-a184-4e23eb40033b req-33ae38a4-4613-4846-a579-d1bb1c3da29a service nova] Creating event network-changed:018f2d3e-909b-488a-af88-b11609f2409d for instance e5633650-dcf9-49be-b565-3e8fb5a765f4 on hv-cinder-86248 Oct 24 13:18:06.232320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-71ebc35f-7245-43e3-a184-4e23eb40033b req-33ae38a4-4613-4846-a579-d1bb1c3da29a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048058 Oct 24 13:18:06.233580 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 367/754] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:06.394715 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-ab82b5b3-2298-48b6-b8ac-5af5b998dcec tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:06.403288 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-ab82b5b3-2298-48b6-b8ac-5af5b998dcec tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e" status: 200 len: 1555 microversion: 2.1 time: 0.267815 Oct 24 13:18:06.404886 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 388/755] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:06 2022] GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e => generated 1555 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:18:06.429626 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-63e41728-e252-41d7-b21f-394afa322c6a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:06.430299 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-63e41728-e252-41d7-b21f-394afa322c6a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:06.437962 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-63e41728-e252-41d7-b21f-394afa322c6a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:06.439710 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-63e41728-e252-41d7-b21f-394afa322c6a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:06.441495 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-63e41728-e252-41d7-b21f-394afa322c6a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:06.442496 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-63e41728-e252-41d7-b21f-394afa322c6a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:06.443249 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-63e41728-e252-41d7-b21f-394afa322c6a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:06.444884 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-63e41728-e252-41d7-b21f-394afa322c6a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:06.699227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-63e41728-e252-41d7-b21f-394afa322c6a tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.275599 Oct 24 13:18:06.699982 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 368/756] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Oct 24 13:18:06 2022] GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e/os-interface => generated 284 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:06.912972 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-361d4fef-e29f-4bec-a8d0-d6a0aae59401 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:06.914119 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-361d4fef-e29f-4bec-a8d0-d6a0aae59401 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:06.920828 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-361d4fef-e29f-4bec-a8d0-d6a0aae59401 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:06.921598 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-361d4fef-e29f-4bec-a8d0-d6a0aae59401 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:06.922174 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-361d4fef-e29f-4bec-a8d0-d6a0aae59401 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:06.923273 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-361d4fef-e29f-4bec-a8d0-d6a0aae59401 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:06.924558 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-361d4fef-e29f-4bec-a8d0-d6a0aae59401 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:06.925220 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-361d4fef-e29f-4bec-a8d0-d6a0aae59401 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:07.196342 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-361d4fef-e29f-4bec-a8d0-d6a0aae59401 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:07.208503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-361d4fef-e29f-4bec-a8d0-d6a0aae59401 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:07.212257 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-361d4fef-e29f-4bec-a8d0-d6a0aae59401 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:07.215271 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-361d4fef-e29f-4bec-a8d0-d6a0aae59401 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1723 microversion: 2.20 time: 0.306382 Oct 24 13:18:07.216525 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 389/757] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:06 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1723 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:07.619610 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-6e80935e-6e75-4bd9-aaf4-977015d6f978 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1418515331", "imageRef": "4d2e5f3e-4aee-48d2-8ada-0b420d141f1b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "99f0061f-b4ea-47ba-a8ca-587da29d9acf"}], "security_groups": [{"name": "tempest-securitygroup--1855086555"}], "key_name": "tempest-keypair-1298102662", "user_data": "}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:07.821530 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.network.neutron [None req-6e80935e-6e75-4bd9-aaf4-977015d6f978 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] validate_networks() for [('99f0061f-b4ea-47ba-a8ca-587da29d9acf', None, None, None, None, None)] {{(pid=118915) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:18:08.147884 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-ab0a3c0c-2053-4046-a348-c670736903c1 req-d1010912-053e-428c-8eb3-3387959f83a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f52b209f-c997-4d1b-9ecf-a4fdc033b64e", "tag": "170c174e-102a-43bf-931e-57ccc699cfd2"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:08.158129 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-ab0a3c0c-2053-4046-a348-c670736903c1 req-d1010912-053e-428c-8eb3-3387959f83a1 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:08.158823 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-ab0a3c0c-2053-4046-a348-c670736903c1 req-d1010912-053e-428c-8eb3-3387959f83a1 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:08.159447 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-ab0a3c0c-2053-4046-a348-c670736903c1 req-d1010912-053e-428c-8eb3-3387959f83a1 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:08.174235 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-ab0a3c0c-2053-4046-a348-c670736903c1 req-d1010912-053e-428c-8eb3-3387959f83a1 service nova] Creating event network-changed:170c174e-102a-43bf-931e-57ccc699cfd2 for instance f52b209f-c997-4d1b-9ecf-a4fdc033b64e on hv-cinder-86248 Oct 24 13:18:08.181333 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-ab0a3c0c-2053-4046-a348-c670736903c1 req-d1010912-053e-428c-8eb3-3387959f83a1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038409 Oct 24 13:18:08.186015 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 390/758] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:18:08.248784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a47f170e-a1be-4e62-a163-41784acbe573 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:08.250352 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a47f170e-a1be-4e62-a163-41784acbe573 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:08.260140 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a47f170e-a1be-4e62-a163-41784acbe573 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:08.261219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a47f170e-a1be-4e62-a163-41784acbe573 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:08.263002 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a47f170e-a1be-4e62-a163-41784acbe573 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:08.266109 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a47f170e-a1be-4e62-a163-41784acbe573 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:08.267501 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a47f170e-a1be-4e62-a163-41784acbe573 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:08.268784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a47f170e-a1be-4e62-a163-41784acbe573 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:08.290176 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=100 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:08.473328 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a47f170e-a1be-4e62-a163-41784acbe573 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:08.483685 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a47f170e-a1be-4e62-a163-41784acbe573 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:08.485478 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a47f170e-a1be-4e62-a163-41784acbe573 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:08.486911 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a47f170e-a1be-4e62-a163-41784acbe573 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1723 microversion: 2.20 time: 0.248910 Oct 24 13:18:08.488030 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 391/759] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:08 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:18:08.749927 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-6e80935e-6e75-4bd9-aaf4-977015d6f978 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Flavor limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:18:08.750437 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-6e80935e-6e75-4bd9-aaf4-977015d6f978 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Image limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:18:08.750802 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-6e80935e-6e75-4bd9-aaf4-977015d6f978 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Flavor pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:18:08.751677 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-6e80935e-6e75-4bd9-aaf4-977015d6f978 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Image pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:18:08.752158 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-6e80935e-6e75-4bd9-aaf4-977015d6f978 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:18:08.762216 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6e80935e-6e75-4bd9-aaf4-977015d6f978 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:08.762778 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6e80935e-6e75-4bd9-aaf4-977015d6f978 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:08.763507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6e80935e-6e75-4bd9-aaf4-977015d6f978 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:08.764479 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6e80935e-6e75-4bd9-aaf4-977015d6f978 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:08.765123 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6e80935e-6e75-4bd9-aaf4-977015d6f978 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:08.765781 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6e80935e-6e75-4bd9-aaf4-977015d6f978 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:08.789386 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-6e80935e-6e75-4bd9-aaf4-977015d6f978 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Getting quotas for project df0bdf3ab29d43e0bf749b9814813e5c. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:18:08.795298 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-6e80935e-6e75-4bd9-aaf4-977015d6f978 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Getting quotas for user 3f69df43e6ca4663a9ef819c0331c13d and project df0bdf3ab29d43e0bf749b9814813e5c. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:18:08.809890 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-6e80935e-6e75-4bd9-aaf4-977015d6f978 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Going to run 1 instances... {{(pid=118915) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:18:08.812730 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-6e80935e-6e75-4bd9-aaf4-977015d6f978 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4d2e5f3e-4aee-48d2-8ada-0b420d141f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:18:08.870630 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-6e80935e-6e75-4bd9-aaf4-977015d6f978 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.257553 Oct 24 13:18:08.872034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 369/760] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 24 13:18:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 1260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:18:08.882822 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-06ea3e04-576b-45b1-821f-e7b4f0b961c6 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:08.883473 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-06ea3e04-576b-45b1-821f-e7b4f0b961c6 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:08.940957 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-06ea3e04-576b-45b1-821f-e7b4f0b961c6 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:08.948330 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-06ea3e04-576b-45b1-821f-e7b4f0b961c6 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc" status: 200 len: 1238 microversion: 2.1 time: 0.069432 Oct 24 13:18:08.963462 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 392/761] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:08 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc => generated 1238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:09.085728 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-36d3950e-aef7-4ef2-9526-308f1cf730c7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:09.086619 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-36d3950e-aef7-4ef2-9526-308f1cf730c7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:09.100541 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-3c3d0840-4bc8-4e80-8613-c4a97d3e0ce3 req-eb3cc386-1db0-4d73-b2f2-f440d5238f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5633650-dcf9-49be-b565-3e8fb5a765f4", "tag": "018f2d3e-909b-488a-af88-b11609f2409d"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:09.111936 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-36d3950e-aef7-4ef2-9526-308f1cf730c7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:09.112443 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-36d3950e-aef7-4ef2-9526-308f1cf730c7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:09.112881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-36d3950e-aef7-4ef2-9526-308f1cf730c7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:09.117437 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-36d3950e-aef7-4ef2-9526-308f1cf730c7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:09.117919 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-36d3950e-aef7-4ef2-9526-308f1cf730c7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:09.118358 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-36d3950e-aef7-4ef2-9526-308f1cf730c7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:09.128047 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-3c3d0840-4bc8-4e80-8613-c4a97d3e0ce3 req-eb3cc386-1db0-4d73-b2f2-f440d5238f17 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:09.128867 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-3c3d0840-4bc8-4e80-8613-c4a97d3e0ce3 req-eb3cc386-1db0-4d73-b2f2-f440d5238f17 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:09.135102 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-3c3d0840-4bc8-4e80-8613-c4a97d3e0ce3 req-eb3cc386-1db0-4d73-b2f2-f440d5238f17 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:09.154845 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-3c3d0840-4bc8-4e80-8613-c4a97d3e0ce3 req-eb3cc386-1db0-4d73-b2f2-f440d5238f17 service nova] Creating event network-changed:018f2d3e-909b-488a-af88-b11609f2409d for instance e5633650-dcf9-49be-b565-3e8fb5a765f4 on hv-cinder-86248 Oct 24 13:18:09.163517 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-3c3d0840-4bc8-4e80-8613-c4a97d3e0ce3 req-eb3cc386-1db0-4d73-b2f2-f440d5238f17 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067715 Oct 24 13:18:09.164885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 393/762] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:18:09.246216 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.objects.instance [None req-36d3950e-aef7-4ef2-9526-308f1cf730c7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lazy-loading 'services' on Instance uuid e5633650-dcf9-49be-b565-3e8fb5a765f4 {{(pid=118915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:18:09.356986 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-36d3950e-aef7-4ef2-9526-308f1cf730c7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4/os-volume_attachments/07d88c15-4a24-4bc5-81d9-cd0a56122e17" status: 202 len: 0 microversion: 2.1 time: 0.276578 Oct 24 13:18:09.357879 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 370/763] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 24 13:18:09 2022] DELETE /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4/os-volume_attachments/07d88c15-4a24-4bc5-81d9-cd0a56122e17 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:18:09.367642 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-5fb745d3-cdc2-40d3-acae-82faa1d417a5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:09.369925 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-5fb745d3-cdc2-40d3-acae-82faa1d417a5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:09.386708 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5fb745d3-cdc2-40d3-acae-82faa1d417a5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:09.387378 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5fb745d3-cdc2-40d3-acae-82faa1d417a5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:09.387830 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5fb745d3-cdc2-40d3-acae-82faa1d417a5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:09.388565 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5fb745d3-cdc2-40d3-acae-82faa1d417a5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:09.389024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5fb745d3-cdc2-40d3-acae-82faa1d417a5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:09.389448 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5fb745d3-cdc2-40d3-acae-82faa1d417a5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:09.445446 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-5fb745d3-cdc2-40d3-acae-82faa1d417a5 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079777 Oct 24 13:18:09.461279 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 394/764] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:18:09 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:09.524164 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-897f03b2-1840-4fb0-ac37-ae36c223c0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:09.525140 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-897f03b2-1840-4fb0-ac37-ae36c223c0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:09.537420 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-6f864c7e-dc2f-4f14-9ace-5d221d6cf99c tempest-VolumesTestJSON-1026012084 tempest-VolumesTestJSON-1026012084-project] Calling method '.version_select at 0x7fad28527dc0>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:09.540928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-897f03b2-1840-4fb0-ac37-ae36c223c0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:09.541584 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-897f03b2-1840-4fb0-ac37-ae36c223c0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:09.542036 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-897f03b2-1840-4fb0-ac37-ae36c223c0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:09.542754 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-897f03b2-1840-4fb0-ac37-ae36c223c0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:09.543241 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-897f03b2-1840-4fb0-ac37-ae36c223c0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:09.543666 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-897f03b2-1840-4fb0-ac37-ae36c223c0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:09.557824 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:09.640836 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-6f864c7e-dc2f-4f14-9ace-5d221d6cf99c tempest-VolumesTestJSON-1026012084 tempest-VolumesTestJSON-1026012084-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/db1ceb9c-9a48-4411-82f3-0e1d224fcf0d" status: 200 len: 351 microversion: 2.1 time: 0.107574 Oct 24 13:18:09.641279 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 395/765] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 24 13:18:09 2022] GET /compute/v2.1/os-volumes/db1ceb9c-9a48-4411-82f3-0e1d224fcf0d => generated 351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:18:09.785706 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-897f03b2-1840-4fb0-ac37-ae36c223c0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:09.794957 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-897f03b2-1840-4fb0-ac37-ae36c223c0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:09.796436 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-897f03b2-1840-4fb0-ac37-ae36c223c0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:09.798026 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-897f03b2-1840-4fb0-ac37-ae36c223c0d0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1723 microversion: 2.20 time: 0.285077 Oct 24 13:18:09.798807 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 371/766] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:09 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:09.974995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-bf815282-9bd3-4a10-b469-0af606f84822 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:09.975772 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-bf815282-9bd3-4a10-b469-0af606f84822 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:09.982328 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bf815282-9bd3-4a10-b469-0af606f84822 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:09.982830 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bf815282-9bd3-4a10-b469-0af606f84822 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:09.983296 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bf815282-9bd3-4a10-b469-0af606f84822 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:09.984009 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bf815282-9bd3-4a10-b469-0af606f84822 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:09.984470 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bf815282-9bd3-4a10-b469-0af606f84822 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:09.984899 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bf815282-9bd3-4a10-b469-0af606f84822 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:10.118631 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-bf815282-9bd3-4a10-b469-0af606f84822 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:10.126682 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-bf815282-9bd3-4a10-b469-0af606f84822 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc" status: 200 len: 1234 microversion: 2.1 time: 0.157378 Oct 24 13:18:10.127667 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 396/767] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:09 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc => generated 1234 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:10.473407 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-0b6a53e9-fb44-415c-b538-908a8de50c77 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:10.475881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-0b6a53e9-fb44-415c-b538-908a8de50c77 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:10.481922 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b6a53e9-fb44-415c-b538-908a8de50c77 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:10.482401 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b6a53e9-fb44-415c-b538-908a8de50c77 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:10.482865 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b6a53e9-fb44-415c-b538-908a8de50c77 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:10.483590 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b6a53e9-fb44-415c-b538-908a8de50c77 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:10.484045 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b6a53e9-fb44-415c-b538-908a8de50c77 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:10.484473 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0b6a53e9-fb44-415c-b538-908a8de50c77 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:10.516556 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-0b6a53e9-fb44-415c-b538-908a8de50c77 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047176 Oct 24 13:18:10.517116 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 372/768] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:18:10 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:10.824698 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-bde9e3d9-5720-4ea5-8a90-92b035b673c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:10.825317 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-bde9e3d9-5720-4ea5-8a90-92b035b673c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:10.831905 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bde9e3d9-5720-4ea5-8a90-92b035b673c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:10.832385 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bde9e3d9-5720-4ea5-8a90-92b035b673c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:10.832823 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bde9e3d9-5720-4ea5-8a90-92b035b673c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:10.833657 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bde9e3d9-5720-4ea5-8a90-92b035b673c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:10.834118 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bde9e3d9-5720-4ea5-8a90-92b035b673c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:10.834549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bde9e3d9-5720-4ea5-8a90-92b035b673c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:10.968562 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-bde9e3d9-5720-4ea5-8a90-92b035b673c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:10.977406 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-bde9e3d9-5720-4ea5-8a90-92b035b673c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:10.978919 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-bde9e3d9-5720-4ea5-8a90-92b035b673c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:10.980188 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-bde9e3d9-5720-4ea5-8a90-92b035b673c5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1723 microversion: 2.20 time: 0.159336 Oct 24 13:18:10.980771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 397/769] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:10 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:11.080449 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-5414e47c-c8eb-4a75-b935-64c0cdde0fb6 tempest-VolumesTestJSON-1026012084 tempest-VolumesTestJSON-1026012084-project] Calling method '.version_select at 0x7fad285b1940>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:11.129828 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-5414e47c-c8eb-4a75-b935-64c0cdde0fb6 tempest-VolumesTestJSON-1026012084 tempest-VolumesTestJSON-1026012084-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/5983ca6f-72db-4486-ba55-9b9dadc59634" status: 200 len: 351 microversion: 2.1 time: 0.054171 Oct 24 13:18:11.130734 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 373/770] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 24 13:18:11 2022] GET /compute/v2.1/os-volumes/5983ca6f-72db-4486-ba55-9b9dadc59634 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:11.150684 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-e9177e90-7de0-4ae3-9745-79671c94eaa9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:11.151646 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-e9177e90-7de0-4ae3-9745-79671c94eaa9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:11.157862 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e9177e90-7de0-4ae3-9745-79671c94eaa9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:11.158349 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e9177e90-7de0-4ae3-9745-79671c94eaa9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:11.158785 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e9177e90-7de0-4ae3-9745-79671c94eaa9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:11.159539 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e9177e90-7de0-4ae3-9745-79671c94eaa9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:11.159992 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e9177e90-7de0-4ae3-9745-79671c94eaa9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:11.160412 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e9177e90-7de0-4ae3-9745-79671c94eaa9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:11.225563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-e9177e90-7de0-4ae3-9745-79671c94eaa9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:11.233544 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-e9177e90-7de0-4ae3-9745-79671c94eaa9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc" status: 200 len: 1296 microversion: 2.1 time: 0.086986 Oct 24 13:18:11.234465 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 398/771] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:11 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc => generated 1296 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:11.529450 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-557d62b9-20a8-494e-b037-87e560bdfdb3 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:11.531689 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-557d62b9-20a8-494e-b037-87e560bdfdb3 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:11.538958 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-557d62b9-20a8-494e-b037-87e560bdfdb3 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:11.539393 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-557d62b9-20a8-494e-b037-87e560bdfdb3 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:11.539821 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-557d62b9-20a8-494e-b037-87e560bdfdb3 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:11.540529 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-557d62b9-20a8-494e-b037-87e560bdfdb3 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:11.540977 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-557d62b9-20a8-494e-b037-87e560bdfdb3 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:11.541581 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-557d62b9-20a8-494e-b037-87e560bdfdb3 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:11.573384 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-557d62b9-20a8-494e-b037-87e560bdfdb3 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047932 Oct 24 13:18:11.574143 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 374/772] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:18:11 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:18:11.584768 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-0cf03de7-f170-44b6-8b02-0a2d0e5b85dc tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:11.585289 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-0cf03de7-f170-44b6-8b02-0a2d0e5b85dc tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:11.591434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0cf03de7-f170-44b6-8b02-0a2d0e5b85dc tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:11.592019 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0cf03de7-f170-44b6-8b02-0a2d0e5b85dc tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:11.592454 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0cf03de7-f170-44b6-8b02-0a2d0e5b85dc tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:11.593149 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0cf03de7-f170-44b6-8b02-0a2d0e5b85dc tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:11.593829 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0cf03de7-f170-44b6-8b02-0a2d0e5b85dc tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:11.594250 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0cf03de7-f170-44b6-8b02-0a2d0e5b85dc tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:11.675268 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-0cf03de7-f170-44b6-8b02-0a2d0e5b85dc tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] HTTP exception thrown: Instance e5633650-dcf9-49be-b565-3e8fb5a765f4 is not attached to volume 07d88c15-4a24-4bc5-81d9-cd0a56122e17 Oct 24 13:18:11.678984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-0cf03de7-f170-44b6-8b02-0a2d0e5b85dc tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Request method failure captured: Oct 24 13:18:11.678984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: DELETE /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4/os-volume_attachments/07d88c15-4a24-4bc5-81d9-cd0a56122e17 HTTP/1.1 Oct 24 13:18:11.678984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:18:11.678984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:18:11.678984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:18:11.678984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:18:11.678984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:18:11.678984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:18:11.678984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:18:11.678984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:18:11.678984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVo_wzLDLtlvUUQSmE1q0cq2lawH7F4N3Y1LO3w0dYRzB7gXwXLr304kYQYmxd0bOfrZUcnKrEdqviJbfr_YoK-gCTCeoGSbkwaUF2BdFSzzFbHNR3zL2BZqcDkyi1VirJyON2_gIEsC-PGCWRBoE9Ah0uQDXQ9TNomV3aL_GTcs2mq0 Oct 24 13:18:11.678984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:18:11.678984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:18:11.678984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:18:11.678984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:18:11.678984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:18:11.678984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:18:11.678984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: e6ab0fbf44394afda8dd8f49818ccc63 Oct 24 13:18:11.678984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-TestMinimumBasicScenario-474643810 Oct 24 13:18:11.678984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:18:11.678984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:18:11.680674 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6ab0fbf44394afda8dd8f49818ccc63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6ab0fbf44394afda8dd8f49818ccc63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6ab0fbf44394afda8dd8f49818ccc63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6ab0fbf44394afda8dd8f49818ccc63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:18:11.680674 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-TestMinimumBasicScenario-474643810 Oct 24 13:18:11.680674 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: e6ab0fbf44394afda8dd8f49818ccc63 Oct 24 13:18:11.680674 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-TestMinimumBasicScenario-474643810 Oct 24 13:18:11.680674 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-TestMinimumBasicScenario-474643810-project Oct 24 13:18:11.680674 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:18:11.680674 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:18:11.680674 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: a769bcc0330a4171948a3cc930bd1ee2 Oct 24 13:18:11.680674 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-TestMinimumBasicScenario-474643810-project Oct 24 13:18:11.680674 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:18:11.680674 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Instance e5633650-dcf9-49be-b565-3e8fb5a765f4 is not attached to volume 07d88c15-4a24-4bc5-81d9-cd0a56122e17 Oct 24 13:18:11.681490 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'server_id': 'e5633650-dcf9-49be-b565-3e8fb5a765f4', 'id': '07d88c15-4a24-4bc5-81d9-cd0a56122e17'} Oct 24 13:18:11.681490 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:18:11.681490 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:18:11.681490 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 24 13:18:11.681490 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 24 13:18:11.681490 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 24 13:18:11.681490 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 24 13:18:11.681490 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 24 13:18:11.681490 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 24 13:18:11.681490 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 07d88c15-4a24-4bc5-81d9-cd0a56122e17. Oct 24 13:18:11.681490 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:18:11.681490 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:18:11.681490 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:18:11.681490 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:18:11.681490 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:18:11.681490 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:18:11.681490 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:18:11.681490 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:18:11.681490 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:18:11.682667 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:18:11.682667 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 24 13:18:11.682667 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 24 13:18:11.682667 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5633650-dcf9-49be-b565-3e8fb5a765f4 is not attached to volume 07d88c15-4a24-4bc5-81d9-cd0a56122e17 Oct 24 13:18:11.682667 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:18:11.682667 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:18:11.682667 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:18:11.682667 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:18:11.682667 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:18:11.682667 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:18:11.682667 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:18:11.682667 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:18:11.682667 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5633650-dcf9-49be-b565-3e8fb5a765f4 is not attached to volume 07d88c15-4a24-4bc5-81d9-cd0a56122e17 Oct 24 13:18:11.682667 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:18:11.682667 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-0cf03de7-f170-44b6-8b02-0a2d0e5b85dc tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Returning 404 to user: Instance e5633650-dcf9-49be-b565-3e8fb5a765f4 is not attached to volume 07d88c15-4a24-4bc5-81d9-cd0a56122e17 {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:18:11.683737 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-0cf03de7-f170-44b6-8b02-0a2d0e5b85dc tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4/os-volume_attachments/07d88c15-4a24-4bc5-81d9-cd0a56122e17" status: 404 len: 154 microversion: 2.1 time: 0.100103 Oct 24 13:18:11.683737 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 399/773] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 24 13:18:11 2022] DELETE /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4/os-volume_attachments/07d88c15-4a24-4bc5-81d9-cd0a56122e17 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:18:12.006146 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-aef030a3-4e6d-405b-98de-8e12c098e714 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:12.006853 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-aef030a3-4e6d-405b-98de-8e12c098e714 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:12.013020 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aef030a3-4e6d-405b-98de-8e12c098e714 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:12.013652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aef030a3-4e6d-405b-98de-8e12c098e714 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:12.014089 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aef030a3-4e6d-405b-98de-8e12c098e714 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:12.014774 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aef030a3-4e6d-405b-98de-8e12c098e714 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:12.015265 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aef030a3-4e6d-405b-98de-8e12c098e714 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:12.015712 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aef030a3-4e6d-405b-98de-8e12c098e714 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:12.253111 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-aef030a3-4e6d-405b-98de-8e12c098e714 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:12.258640 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-67b738fa-887c-49c7-bdf3-1b84b0529645 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:12.259408 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-67b738fa-887c-49c7-bdf3-1b84b0529645 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:12.263760 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-aef030a3-4e6d-405b-98de-8e12c098e714 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:12.265919 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-aef030a3-4e6d-405b-98de-8e12c098e714 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:12.266220 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-67b738fa-887c-49c7-bdf3-1b84b0529645 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:12.267091 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-67b738fa-887c-49c7-bdf3-1b84b0529645 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:12.267355 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-aef030a3-4e6d-405b-98de-8e12c098e714 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1723 microversion: 2.20 time: 0.265268 Oct 24 13:18:12.283078 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 375/774] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:12 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:12.283825 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-67b738fa-887c-49c7-bdf3-1b84b0529645 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:12.284626 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-67b738fa-887c-49c7-bdf3-1b84b0529645 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:12.285098 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-67b738fa-887c-49c7-bdf3-1b84b0529645 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:12.285528 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-67b738fa-887c-49c7-bdf3-1b84b0529645 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:12.415513 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-67b738fa-887c-49c7-bdf3-1b84b0529645 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:12.423332 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-67b738fa-887c-49c7-bdf3-1b84b0529645 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc" status: 200 len: 1364 microversion: 2.1 time: 0.170061 Oct 24 13:18:12.423893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 400/775] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:12 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:18:12.451197 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-2f66a97c-4d40-4548-861b-19b47d89676c req-ff496893-62f8-42c5-9a91-f292bd856916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a61a38e-37d5-4a07-8990-10906e3122dc", "tag": "b2e03576-01e9-4c65-aae0-ffd1580274d1"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:12.462778 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-2f66a97c-4d40-4548-861b-19b47d89676c req-ff496893-62f8-42c5-9a91-f292bd856916 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:12.463486 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-2f66a97c-4d40-4548-861b-19b47d89676c req-ff496893-62f8-42c5-9a91-f292bd856916 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:12.464014 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-2f66a97c-4d40-4548-861b-19b47d89676c req-ff496893-62f8-42c5-9a91-f292bd856916 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:12.477079 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-2f66a97c-4d40-4548-861b-19b47d89676c req-ff496893-62f8-42c5-9a91-f292bd856916 service nova] Creating event network-changed:b2e03576-01e9-4c65-aae0-ffd1580274d1 for instance 4a61a38e-37d5-4a07-8990-10906e3122dc on hv-cinder-86248 Oct 24 13:18:12.484436 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-2f66a97c-4d40-4548-861b-19b47d89676c req-ff496893-62f8-42c5-9a91-f292bd856916 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038104 Oct 24 13:18:12.485264 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 376/776] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:12.517018 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-5b586f3e-b441-442b-8163-1a9e0fb9227c tempest-VolumesTestJSON-1026012084 tempest-VolumesTestJSON-1026012084-project] Calling method '.version_select at 0x7fad28441f70>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:12.566298 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-5b586f3e-b441-442b-8163-1a9e0fb9227c tempest-VolumesTestJSON-1026012084 tempest-VolumesTestJSON-1026012084-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/95ae1f94-8221-4ec6-8396-4721b35390b5" status: 200 len: 350 microversion: 2.1 time: 0.053027 Oct 24 13:18:12.566865 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 401/777] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 24 13:18:12 2022] GET /compute/v2.1/os-volumes/95ae1f94-8221-4ec6-8396-4721b35390b5 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:12.580575 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-2c4aaa2a-1b87-48cb-8af5-9e72cdf05cbb tempest-VolumesTestJSON-1026012084 tempest-VolumesTestJSON-1026012084-project] Calling method '.version_select at 0x7fad28514310>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:12.664465 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-2c4aaa2a-1b87-48cb-8af5-9e72cdf05cbb tempest-VolumesTestJSON-1026012084 tempest-VolumesTestJSON-1026012084-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088081 Oct 24 13:18:12.665035 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 377/778] 10.222.0.42 () {58 vars in 1134 bytes} [Mon Oct 24 13:18:12 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:12.681125 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-4430d66d-a983-47ca-8f27-24b72a19765e tempest-VolumesTestJSON-1026012084 tempest-VolumesTestJSON-1026012084-project] Calling method '.version_select at 0x7fad283ee280>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:12.765972 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-4430d66d-a983-47ca-8f27-24b72a19765e tempest-VolumesTestJSON-1026012084 tempest-VolumesTestJSON-1026012084-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089648 Oct 24 13:18:12.766674 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 402/779] 10.222.0.42 () {58 vars in 1149 bytes} [Mon Oct 24 13:18:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:12.780199 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-e823b301-2232-48ed-a841-6c4638329ddb tempest-VolumesTestJSON-1026012084 tempest-VolumesTestJSON-1026012084-project] Calling method '.version_select at 0x7fad284a6d30>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:12.840895 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-b485670a-c8d7-4af1-b4a1-adf5c7dc7f6f tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:12.841399 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-b485670a-c8d7-4af1-b4a1-adf5c7dc7f6f tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:12.848314 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b485670a-c8d7-4af1-b4a1-adf5c7dc7f6f tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:12.848800 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b485670a-c8d7-4af1-b4a1-adf5c7dc7f6f tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:12.849234 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b485670a-c8d7-4af1-b4a1-adf5c7dc7f6f tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:12.849932 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b485670a-c8d7-4af1-b4a1-adf5c7dc7f6f tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:12.850382 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b485670a-c8d7-4af1-b4a1-adf5c7dc7f6f tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:12.850977 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b485670a-c8d7-4af1-b4a1-adf5c7dc7f6f tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:12.870434 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-e823b301-2232-48ed-a841-6c4638329ddb tempest-VolumesTestJSON-1026012084 tempest-VolumesTestJSON-1026012084-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.093894 Oct 24 13:18:12.871472 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 378/780] 10.222.0.42 () {58 vars in 1134 bytes} [Mon Oct 24 13:18:12 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:12.882835 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-b485670a-c8d7-4af1-b4a1-adf5c7dc7f6f tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Going to try to terminate instance {{(pid=118914) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:18:12.884784 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-a371dcf9-76c5-4fe5-8705-4c5fcfb287bf tempest-VolumesTestJSON-1026012084 tempest-VolumesTestJSON-1026012084-project] Calling method '.version_select at 0x7fad2849c790>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:12.968373 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-b485670a-c8d7-4af1-b4a1-adf5c7dc7f6f tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 204 len: 0 microversion: 2.1 time: 0.131250 Oct 24 13:18:12.969020 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 403/781] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:18:12 2022] DELETE /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 24 13:18:12.970373 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-a371dcf9-76c5-4fe5-8705-4c5fcfb287bf tempest-VolumesTestJSON-1026012084 tempest-VolumesTestJSON-1026012084-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089707 Oct 24 13:18:12.971360 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 379/782] 10.222.0.42 () {58 vars in 1167 bytes} [Mon Oct 24 13:18:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:18:12.979944 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d4a0b25d-7d1a-439d-b093-e11b051d6730 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:12.980640 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-d4a0b25d-7d1a-439d-b093-e11b051d6730 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:12.984388 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-db0e7b3c-374d-40b2-b09b-dfd6cc036f72 tempest-VolumesTestJSON-1026012084 tempest-VolumesTestJSON-1026012084-project] Calling method '.version_select at 0x7fad284a6820>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:12.986452 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d4a0b25d-7d1a-439d-b093-e11b051d6730 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:12.986931 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d4a0b25d-7d1a-439d-b093-e11b051d6730 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:12.987399 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d4a0b25d-7d1a-439d-b093-e11b051d6730 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:12.988082 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d4a0b25d-7d1a-439d-b093-e11b051d6730 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:12.988528 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d4a0b25d-7d1a-439d-b093-e11b051d6730 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:12.988942 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d4a0b25d-7d1a-439d-b093-e11b051d6730 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:13.069932 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-db0e7b3c-374d-40b2-b09b-dfd6cc036f72 tempest-VolumesTestJSON-1026012084 tempest-VolumesTestJSON-1026012084-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089078 Oct 24 13:18:13.070640 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 380/783] 10.222.0.42 () {58 vars in 1170 bytes} [Mon Oct 24 13:18:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:18:13.084158 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8cd667df-2e27-48b2-bfa1-0f77d02433aa tempest-VolumesTestJSON-1026012084 tempest-VolumesTestJSON-1026012084-project] Calling method '.version_select at 0x7fad285148b0>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:13.128612 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-d4a0b25d-7d1a-439d-b093-e11b051d6730 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:13.136854 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-d4a0b25d-7d1a-439d-b093-e11b051d6730 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1552 microversion: 2.1 time: 0.160887 Oct 24 13:18:13.137441 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 404/784] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:12 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:18:13.166659 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-8cd667df-2e27-48b2-bfa1-0f77d02433aa tempest-VolumesTestJSON-1026012084 tempest-VolumesTestJSON-1026012084-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086266 Oct 24 13:18:13.167266 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 381/785] 10.222.0.42 () {58 vars in 1155 bytes} [Mon Oct 24 13:18:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:18:13.181585 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-55de7070-388e-4867-94a2-68ed561e2de3 tempest-VolumesTestJSON-1026012084 tempest-VolumesTestJSON-1026012084-project] Calling method '.version_select at 0x7fad283c8790>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:13.293437 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-35615c9e-e422-46db-9263-6434a2fec9b4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:13.294172 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-35615c9e-e422-46db-9263-6434a2fec9b4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:13.300847 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-35615c9e-e422-46db-9263-6434a2fec9b4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:13.301348 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-35615c9e-e422-46db-9263-6434a2fec9b4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:13.301784 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-35615c9e-e422-46db-9263-6434a2fec9b4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:13.302501 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-35615c9e-e422-46db-9263-6434a2fec9b4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:13.303074 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-35615c9e-e422-46db-9263-6434a2fec9b4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:13.303520 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-35615c9e-e422-46db-9263-6434a2fec9b4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:13.418241 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-55de7070-388e-4867-94a2-68ed561e2de3 tempest-VolumesTestJSON-1026012084 tempest-VolumesTestJSON-1026012084-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.241536 Oct 24 13:18:13.418874 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 405/786] 10.222.0.42 () {58 vars in 1188 bytes} [Mon Oct 24 13:18:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:13.432989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d9b738c8-2cf7-497e-9f1e-94681a7406f8 tempest-VolumesTestJSON-1026012084 tempest-VolumesTestJSON-1026012084-project] Calling method '.version_select at 0x7fad283de430>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:13.449231 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-35615c9e-e422-46db-9263-6434a2fec9b4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:13.457464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-35615c9e-e422-46db-9263-6434a2fec9b4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:13.459116 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-35615c9e-e422-46db-9263-6434a2fec9b4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:13.460291 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-35615c9e-e422-46db-9263-6434a2fec9b4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1723 microversion: 2.20 time: 0.170847 Oct 24 13:18:13.460846 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 382/787] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:13 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:18:13.465328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-49fd8806-1eb8-4459-a150-b14238b7a49d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:13.465941 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-49fd8806-1eb8-4459-a150-b14238b7a49d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:13.472319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-49fd8806-1eb8-4459-a150-b14238b7a49d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:13.472806 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-49fd8806-1eb8-4459-a150-b14238b7a49d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:13.473244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-49fd8806-1eb8-4459-a150-b14238b7a49d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:13.474087 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-49fd8806-1eb8-4459-a150-b14238b7a49d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:13.474553 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-49fd8806-1eb8-4459-a150-b14238b7a49d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:13.474981 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-49fd8806-1eb8-4459-a150-b14238b7a49d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:13.519434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-d9b738c8-2cf7-497e-9f1e-94681a7406f8 tempest-VolumesTestJSON-1026012084 tempest-VolumesTestJSON-1026012084-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.089942 Oct 24 13:18:13.520008 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 406/788] 10.222.0.42 () {58 vars in 1155 bytes} [Mon Oct 24 13:18:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:13.609306 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-49fd8806-1eb8-4459-a150-b14238b7a49d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:13.622348 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-49fd8806-1eb8-4459-a150-b14238b7a49d tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc" status: 200 len: 1364 microversion: 2.1 time: 0.160460 Oct 24 13:18:13.638997 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 383/789] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:13 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:14.160707 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-dbf52aa3-add2-4940-ac53-27b9c7616c7b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:14.161880 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-dbf52aa3-add2-4940-ac53-27b9c7616c7b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:14.167831 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dbf52aa3-add2-4940-ac53-27b9c7616c7b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:14.168314 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dbf52aa3-add2-4940-ac53-27b9c7616c7b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:14.168747 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dbf52aa3-add2-4940-ac53-27b9c7616c7b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:14.169428 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dbf52aa3-add2-4940-ac53-27b9c7616c7b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:14.169880 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dbf52aa3-add2-4940-ac53-27b9c7616c7b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:14.170300 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-dbf52aa3-add2-4940-ac53-27b9c7616c7b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:14.296340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-dbf52aa3-add2-4940-ac53-27b9c7616c7b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:14.304083 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-dbf52aa3-add2-4940-ac53-27b9c7616c7b tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1552 microversion: 2.1 time: 0.147449 Oct 24 13:18:14.304647 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 407/790] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:14 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1552 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:14.485289 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-b1799849-b886-4e10-bbe4-65e940543197 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:14.485910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-b1799849-b886-4e10-bbe4-65e940543197 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:14.492470 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b1799849-b886-4e10-bbe4-65e940543197 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:14.492959 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b1799849-b886-4e10-bbe4-65e940543197 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:14.493426 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b1799849-b886-4e10-bbe4-65e940543197 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:14.494120 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b1799849-b886-4e10-bbe4-65e940543197 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:14.494585 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b1799849-b886-4e10-bbe4-65e940543197 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:14.495007 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b1799849-b886-4e10-bbe4-65e940543197 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:14.628009 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-b1799849-b886-4e10-bbe4-65e940543197 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:14.636276 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-b1799849-b886-4e10-bbe4-65e940543197 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:14.637713 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-b1799849-b886-4e10-bbe4-65e940543197 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:14.638882 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-b1799849-b886-4e10-bbe4-65e940543197 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1723 microversion: 2.20 time: 0.157520 Oct 24 13:18:14.639476 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 384/791] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:14 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:14.645694 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a4199eb5-b37b-43c0-9b14-ef6bff9d4e50 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:14.646517 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a4199eb5-b37b-43c0-9b14-ef6bff9d4e50 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:14.652521 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4199eb5-b37b-43c0-9b14-ef6bff9d4e50 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:14.652985 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4199eb5-b37b-43c0-9b14-ef6bff9d4e50 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:14.653416 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4199eb5-b37b-43c0-9b14-ef6bff9d4e50 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:14.654101 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4199eb5-b37b-43c0-9b14-ef6bff9d4e50 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:14.654549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4199eb5-b37b-43c0-9b14-ef6bff9d4e50 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:14.654970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4199eb5-b37b-43c0-9b14-ef6bff9d4e50 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:14.791885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a4199eb5-b37b-43c0-9b14-ef6bff9d4e50 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:14.799703 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a4199eb5-b37b-43c0-9b14-ef6bff9d4e50 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc" status: 200 len: 1364 microversion: 2.1 time: 0.157892 Oct 24 13:18:14.800258 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 408/792] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:14 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:15.326093 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-6642b2e5-6078-4e83-bda4-7a9dc832b2fa tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:15.326708 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-6642b2e5-6078-4e83-bda4-7a9dc832b2fa tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:15.332723 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6642b2e5-6078-4e83-bda4-7a9dc832b2fa tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:15.333898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6642b2e5-6078-4e83-bda4-7a9dc832b2fa tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:15.334537 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6642b2e5-6078-4e83-bda4-7a9dc832b2fa tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:15.334982 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6642b2e5-6078-4e83-bda4-7a9dc832b2fa tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:15.335465 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6642b2e5-6078-4e83-bda4-7a9dc832b2fa tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:15.335890 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6642b2e5-6078-4e83-bda4-7a9dc832b2fa tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:15.665140 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-949a9f5d-cf42-40c1-9730-381c85dd1097 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:15.665677 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-6642b2e5-6078-4e83-bda4-7a9dc832b2fa tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:15.666049 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-949a9f5d-cf42-40c1-9730-381c85dd1097 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:15.672055 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-949a9f5d-cf42-40c1-9730-381c85dd1097 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:15.672731 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-949a9f5d-cf42-40c1-9730-381c85dd1097 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:15.673419 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-6642b2e5-6078-4e83-bda4-7a9dc832b2fa tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1552 microversion: 2.1 time: 0.351095 Oct 24 13:18:15.673549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-949a9f5d-cf42-40c1-9730-381c85dd1097 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:15.674196 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-949a9f5d-cf42-40c1-9730-381c85dd1097 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:15.674625 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 385/793] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:15 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1552 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:15.674735 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-949a9f5d-cf42-40c1-9730-381c85dd1097 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:15.675241 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-949a9f5d-cf42-40c1-9730-381c85dd1097 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:15.809645 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-949a9f5d-cf42-40c1-9730-381c85dd1097 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:15.822061 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-949a9f5d-cf42-40c1-9730-381c85dd1097 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:15.823934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-949a9f5d-cf42-40c1-9730-381c85dd1097 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:15.824525 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-2124a2c2-937a-4e4a-834b-cdcffb43be7c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:15.825257 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-2124a2c2-937a-4e4a-834b-cdcffb43be7c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:15.825830 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-949a9f5d-cf42-40c1-9730-381c85dd1097 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1744 microversion: 2.20 time: 0.165380 Oct 24 13:18:15.826849 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 409/794] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:15 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:18:15.838221 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2124a2c2-937a-4e4a-834b-cdcffb43be7c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:15.838725 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2124a2c2-937a-4e4a-834b-cdcffb43be7c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:15.839189 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2124a2c2-937a-4e4a-834b-cdcffb43be7c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:15.839886 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2124a2c2-937a-4e4a-834b-cdcffb43be7c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:15.840502 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2124a2c2-937a-4e4a-834b-cdcffb43be7c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:15.841085 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2124a2c2-937a-4e4a-834b-cdcffb43be7c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:16.082002 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-2124a2c2-937a-4e4a-834b-cdcffb43be7c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:16.098199 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-2124a2c2-937a-4e4a-834b-cdcffb43be7c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc" status: 200 len: 1364 microversion: 2.1 time: 0.277820 Oct 24 13:18:16.099396 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 386/795] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:15 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc => generated 1364 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:16.235110 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-55471e15-acf2-455e-a5ca-65352403644b req-e9288288-dfd8-4559-a7d2-c717387a8ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5633650-dcf9-49be-b565-3e8fb5a765f4", "name": "network-vif-deleted", "tag": "018f2d3e-909b-488a-af88-b11609f2409d"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:16.245862 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-55471e15-acf2-455e-a5ca-65352403644b req-e9288288-dfd8-4559-a7d2-c717387a8ae4 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:16.246343 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-55471e15-acf2-455e-a5ca-65352403644b req-e9288288-dfd8-4559-a7d2-c717387a8ae4 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:16.246775 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-55471e15-acf2-455e-a5ca-65352403644b req-e9288288-dfd8-4559-a7d2-c717387a8ae4 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:16.260098 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-55471e15-acf2-455e-a5ca-65352403644b req-e9288288-dfd8-4559-a7d2-c717387a8ae4 service nova] Creating event network-vif-deleted:018f2d3e-909b-488a-af88-b11609f2409d for instance e5633650-dcf9-49be-b565-3e8fb5a765f4 on hv-cinder-86248 Oct 24 13:18:16.265425 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-55471e15-acf2-455e-a5ca-65352403644b req-e9288288-dfd8-4559-a7d2-c717387a8ae4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034229 Oct 24 13:18:16.266009 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 410/796] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:16.697770 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-28c2b5a2-1e43-4997-bcbe-ca8a8eed34a7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:16.698398 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-28c2b5a2-1e43-4997-bcbe-ca8a8eed34a7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:16.704847 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-28c2b5a2-1e43-4997-bcbe-ca8a8eed34a7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:16.705326 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-28c2b5a2-1e43-4997-bcbe-ca8a8eed34a7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:16.705756 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-28c2b5a2-1e43-4997-bcbe-ca8a8eed34a7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:16.706471 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-28c2b5a2-1e43-4997-bcbe-ca8a8eed34a7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:16.706915 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-28c2b5a2-1e43-4997-bcbe-ca8a8eed34a7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:16.707483 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-28c2b5a2-1e43-4997-bcbe-ca8a8eed34a7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:16.740623 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-28c2b5a2-1e43-4997-bcbe-ca8a8eed34a7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:16.740623 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-28c2b5a2-1e43-4997-bcbe-ca8a8eed34a7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:16.740928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-28c2b5a2-1e43-4997-bcbe-ca8a8eed34a7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:16.741386 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.objects.instance [None req-28c2b5a2-1e43-4997-bcbe-ca8a8eed34a7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lazy-loading 'fault' on Instance uuid e5633650-dcf9-49be-b565-3e8fb5a765f4 {{(pid=118915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:18:16.794145 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-28c2b5a2-1e43-4997-bcbe-ca8a8eed34a7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a769bcc0330a4171948a3cc930bd1ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6ab0fbf44394afda8dd8f49818ccc63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:16.803439 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-28c2b5a2-1e43-4997-bcbe-ca8a8eed34a7 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 200 len: 1347 microversion: 2.1 time: 0.108335 Oct 24 13:18:16.804006 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 387/797] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:16 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 1347 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:16.854083 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c8d1905a-aecb-43ae-806e-07b58311f146 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:16.854792 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-c8d1905a-aecb-43ae-806e-07b58311f146 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:16.862071 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c8d1905a-aecb-43ae-806e-07b58311f146 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:16.862071 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c8d1905a-aecb-43ae-806e-07b58311f146 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:16.862071 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c8d1905a-aecb-43ae-806e-07b58311f146 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:16.862775 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c8d1905a-aecb-43ae-806e-07b58311f146 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:16.863338 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c8d1905a-aecb-43ae-806e-07b58311f146 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:16.863758 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c8d1905a-aecb-43ae-806e-07b58311f146 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:17.024267 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-c8d1905a-aecb-43ae-806e-07b58311f146 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:17.032385 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-c8d1905a-aecb-43ae-806e-07b58311f146 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:17.033830 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-c8d1905a-aecb-43ae-806e-07b58311f146 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:17.035024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-c8d1905a-aecb-43ae-806e-07b58311f146 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1744 microversion: 2.20 time: 0.186693 Oct 24 13:18:17.035609 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 411/798] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:16 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1744 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:17.123184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-79d2e9af-00a6-48e6-959f-590a11d51461 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:17.124062 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-79d2e9af-00a6-48e6-959f-590a11d51461 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:17.130956 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79d2e9af-00a6-48e6-959f-590a11d51461 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:17.131758 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79d2e9af-00a6-48e6-959f-590a11d51461 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:17.132585 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79d2e9af-00a6-48e6-959f-590a11d51461 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:17.133714 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79d2e9af-00a6-48e6-959f-590a11d51461 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:17.134188 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79d2e9af-00a6-48e6-959f-590a11d51461 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:17.134644 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-79d2e9af-00a6-48e6-959f-590a11d51461 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:17.287268 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-79d2e9af-00a6-48e6-959f-590a11d51461 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:17.296257 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-79d2e9af-00a6-48e6-959f-590a11d51461 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc" status: 200 len: 1364 microversion: 2.1 time: 0.178399 Oct 24 13:18:17.297187 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 388/799] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:17 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:17.835994 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-6941a88b-68eb-4d8d-8ce4-5958f8bf0e75 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:17.836749 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-6941a88b-68eb-4d8d-8ce4-5958f8bf0e75 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] [instance: e5633650-dcf9-49be-b565-3e8fb5a765f4] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:17.842915 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6941a88b-68eb-4d8d-8ce4-5958f8bf0e75 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:17.843612 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6941a88b-68eb-4d8d-8ce4-5958f8bf0e75 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:17.844191 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6941a88b-68eb-4d8d-8ce4-5958f8bf0e75 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:17.844981 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6941a88b-68eb-4d8d-8ce4-5958f8bf0e75 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:17.849985 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6941a88b-68eb-4d8d-8ce4-5958f8bf0e75 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:17.850475 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6941a88b-68eb-4d8d-8ce4-5958f8bf0e75 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:17.867378 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-6941a88b-68eb-4d8d-8ce4-5958f8bf0e75 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] HTTP exception thrown: Instance e5633650-dcf9-49be-b565-3e8fb5a765f4 could not be found. Oct 24 13:18:17.870336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-6941a88b-68eb-4d8d-8ce4-5958f8bf0e75 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Request method failure captured: Oct 24 13:18:17.870336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 HTTP/1.1 Oct 24 13:18:17.870336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:18:17.870336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:18:17.870336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:18:17.870336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:18:17.870336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:18:17.870336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:18:17.870336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:18:17.870336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:18:17.870336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVo_wzLDLtlvUUQSmE1q0cq2lawH7F4N3Y1LO3w0dYRzB7gXwXLr304kYQYmxd0bOfrZUcnKrEdqviJbfr_YoK-gCTCeoGSbkwaUF2BdFSzzFbHNR3zL2BZqcDkyi1VirJyON2_gIEsC-PGCWRBoE9Ah0uQDXQ9TNomV3aL_GTcs2mq0 Oct 24 13:18:17.870336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:18:17.870336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:18:17.870336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:18:17.870336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:18:17.870336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:18:17.870336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:18:17.870336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: e6ab0fbf44394afda8dd8f49818ccc63 Oct 24 13:18:17.870336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-TestMinimumBasicScenario-474643810 Oct 24 13:18:17.870336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:18:17.870336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:18:17.872004 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e6ab0fbf44394afda8dd8f49818ccc63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6ab0fbf44394afda8dd8f49818ccc63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e6ab0fbf44394afda8dd8f49818ccc63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e6ab0fbf44394afda8dd8f49818ccc63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:18:17.872004 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-TestMinimumBasicScenario-474643810 Oct 24 13:18:17.872004 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: e6ab0fbf44394afda8dd8f49818ccc63 Oct 24 13:18:17.872004 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-TestMinimumBasicScenario-474643810 Oct 24 13:18:17.872004 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-TestMinimumBasicScenario-474643810-project Oct 24 13:18:17.872004 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:18:17.872004 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:18:17.872004 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: a769bcc0330a4171948a3cc930bd1ee2 Oct 24 13:18:17.872004 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-TestMinimumBasicScenario-474643810-project Oct 24 13:18:17.872004 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:18:17.872004 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Instance e5633650-dcf9-49be-b565-3e8fb5a765f4 could not be found. Oct 24 13:18:17.872004 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': 'e5633650-dcf9-49be-b565-3e8fb5a765f4'} Oct 24 13:18:17.872943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:18:17.872943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:18:17.872943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:18:17.872943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:18:17.872943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:18:17.872943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:18:17.872943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:18:17.872943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:18:17.872943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:18:17.872943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:18:17.872943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5633650-dcf9-49be-b565-3e8fb5a765f4 could not be found. Oct 24 13:18:17.872943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:18:17.872943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:18:17.872943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:18:17.872943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:18:17.872943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:18:17.872943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:18:17.872943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:18:17.872943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:18:17.872943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:18:17.874412 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:18:17.874412 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:18:17.874412 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:18:17.874412 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:18:17.874412 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:18:17.874412 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:18:17.874412 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:18:17.874412 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5633650-dcf9-49be-b565-3e8fb5a765f4 could not be found. Oct 24 13:18:17.874412 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:18:17.874412 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:18:17.874412 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:18:17.874412 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:18:17.874412 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:18:17.874412 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:18:17.874412 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:18:17.874412 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:18:17.874412 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5633650-dcf9-49be-b565-3e8fb5a765f4 could not be found. Oct 24 13:18:17.874412 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:18:17.875891 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-6941a88b-68eb-4d8d-8ce4-5958f8bf0e75 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Returning 404 to user: Instance e5633650-dcf9-49be-b565-3e8fb5a765f4 could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:18:17.875891 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-6941a88b-68eb-4d8d-8ce4-5958f8bf0e75 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4" status: 404 len: 111 microversion: 2.1 time: 0.040986 Oct 24 13:18:17.875891 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 412/800] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:17 2022] GET /compute/v2.1/servers/e5633650-dcf9-49be-b565-3e8fb5a765f4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:18:17.882480 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-a2100793-6412-41dc-8a03-04428a4c4e55 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] Calling method '.version_select at 0x7fad284a6550>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:17.905737 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-a2100793-6412-41dc-8a03-04428a4c4e55 tempest-TestMinimumBasicScenario-474643810 tempest-TestMinimumBasicScenario-474643810-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-702735127" status: 202 len: 0 microversion: 2.1 time: 0.027264 Oct 24 13:18:17.906739 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 389/801] 10.222.0.42 () {58 vars in 1269 bytes} [Mon Oct 24 13:18:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-702735127 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:18:18.061342 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-5441ec89-3f96-40b0-99f7-84d60ec4e765 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:18.062000 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-5441ec89-3f96-40b0-99f7-84d60ec4e765 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:18.070273 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5441ec89-3f96-40b0-99f7-84d60ec4e765 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:18.075786 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5441ec89-3f96-40b0-99f7-84d60ec4e765 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:18.075786 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5441ec89-3f96-40b0-99f7-84d60ec4e765 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:18.075786 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5441ec89-3f96-40b0-99f7-84d60ec4e765 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:18.075786 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5441ec89-3f96-40b0-99f7-84d60ec4e765 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:18.076740 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5441ec89-3f96-40b0-99f7-84d60ec4e765 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:18.241498 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-5441ec89-3f96-40b0-99f7-84d60ec4e765 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:18.251914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-5441ec89-3f96-40b0-99f7-84d60ec4e765 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:18.253467 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-5441ec89-3f96-40b0-99f7-84d60ec4e765 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:18.254929 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-5441ec89-3f96-40b0-99f7-84d60ec4e765 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1739 microversion: 2.20 time: 0.198049 Oct 24 13:18:18.255776 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 413/802] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:18 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:18.321501 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-56afc5b8-637c-444f-9af2-0a009a7a162c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:18.322718 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-56afc5b8-637c-444f-9af2-0a009a7a162c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:18.336718 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-b31b916c-0341-41ac-a2a5-789016a9cbbf req-e216da73-3b99-40dc-b20a-eb44435c6eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a61a38e-37d5-4a07-8990-10906e3122dc", "name": "network-vif-plugged", "status": "completed", "tag": "b2e03576-01e9-4c65-aae0-ffd1580274d1"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:18.342025 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-56afc5b8-637c-444f-9af2-0a009a7a162c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:18.344822 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-56afc5b8-637c-444f-9af2-0a009a7a162c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:18.347546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-56afc5b8-637c-444f-9af2-0a009a7a162c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:18.350114 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-56afc5b8-637c-444f-9af2-0a009a7a162c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:18.352626 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-56afc5b8-637c-444f-9af2-0a009a7a162c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:18.353584 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-56afc5b8-637c-444f-9af2-0a009a7a162c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:18.358343 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-b31b916c-0341-41ac-a2a5-789016a9cbbf req-e216da73-3b99-40dc-b20a-eb44435c6eed service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:18.360076 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-b31b916c-0341-41ac-a2a5-789016a9cbbf req-e216da73-3b99-40dc-b20a-eb44435c6eed service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:18.361435 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-b31b916c-0341-41ac-a2a5-789016a9cbbf req-e216da73-3b99-40dc-b20a-eb44435c6eed service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:18.373079 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:18.398558 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-b31b916c-0341-41ac-a2a5-789016a9cbbf req-e216da73-3b99-40dc-b20a-eb44435c6eed service nova] Creating event network-vif-plugged:b2e03576-01e9-4c65-aae0-ffd1580274d1 for instance 4a61a38e-37d5-4a07-8990-10906e3122dc on hv-cinder-86248 Oct 24 13:18:18.415385 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-b31b916c-0341-41ac-a2a5-789016a9cbbf req-e216da73-3b99-40dc-b20a-eb44435c6eed service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081388 Oct 24 13:18:18.416399 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 414/803] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:18:18.672188 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-56afc5b8-637c-444f-9af2-0a009a7a162c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:18.683907 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-56afc5b8-637c-444f-9af2-0a009a7a162c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc" status: 200 len: 1364 microversion: 2.1 time: 0.368110 Oct 24 13:18:18.684487 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 390/804] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:18 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc => generated 1364 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:19.286638 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-330fbc77-cc72-4bed-a584-826b77f4fd98 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:19.287644 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-330fbc77-cc72-4bed-a584-826b77f4fd98 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:19.299858 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=2 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:19.305220 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-330fbc77-cc72-4bed-a584-826b77f4fd98 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:19.305692 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-330fbc77-cc72-4bed-a584-826b77f4fd98 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:19.306178 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-330fbc77-cc72-4bed-a584-826b77f4fd98 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:19.306808 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-330fbc77-cc72-4bed-a584-826b77f4fd98 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:19.310917 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-330fbc77-cc72-4bed-a584-826b77f4fd98 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:19.311606 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-330fbc77-cc72-4bed-a584-826b77f4fd98 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:19.679656 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-330fbc77-cc72-4bed-a584-826b77f4fd98 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:19.688157 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-330fbc77-cc72-4bed-a584-826b77f4fd98 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:19.689784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-330fbc77-cc72-4bed-a584-826b77f4fd98 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:19.690937 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-330fbc77-cc72-4bed-a584-826b77f4fd98 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1739 microversion: 2.20 time: 0.408870 Oct 24 13:18:19.697058 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 415/805] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:19 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1739 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:19.708650 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-bd7bbbbf-239f-43f7-825b-d28ceacf4616 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:19.709638 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-bd7bbbbf-239f-43f7-825b-d28ceacf4616 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:19.711720 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=2 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:19.712621 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=10 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:19.720358 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bd7bbbbf-239f-43f7-825b-d28ceacf4616 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:19.721281 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bd7bbbbf-239f-43f7-825b-d28ceacf4616 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:19.721955 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bd7bbbbf-239f-43f7-825b-d28ceacf4616 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:19.722988 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bd7bbbbf-239f-43f7-825b-d28ceacf4616 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:19.724414 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bd7bbbbf-239f-43f7-825b-d28ceacf4616 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:19.725243 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bd7bbbbf-239f-43f7-825b-d28ceacf4616 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:19.938846 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-bd7bbbbf-239f-43f7-825b-d28ceacf4616 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:19.947832 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-bd7bbbbf-239f-43f7-825b-d28ceacf4616 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc" status: 200 len: 1364 microversion: 2.1 time: 0.243473 Oct 24 13:18:19.964020 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 391/806] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:19 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:18:20.438428 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-c38694df-2541-48ba-b29c-bed348b07ac7 req-067ac23d-4bea-476c-9e26-b53f5091b23a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54a71380-34c3-40b5-a376-1622f1e44528", "name": "network-vif-plugged", "status": "completed", "tag": "486a8286-8bd4-4826-a629-5c1b4c9df0e1"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:20.460214 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-c38694df-2541-48ba-b29c-bed348b07ac7 req-067ac23d-4bea-476c-9e26-b53f5091b23a service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:20.460678 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-c38694df-2541-48ba-b29c-bed348b07ac7 req-067ac23d-4bea-476c-9e26-b53f5091b23a service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:20.461587 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-c38694df-2541-48ba-b29c-bed348b07ac7 req-067ac23d-4bea-476c-9e26-b53f5091b23a service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:20.487224 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-c38694df-2541-48ba-b29c-bed348b07ac7 req-067ac23d-4bea-476c-9e26-b53f5091b23a service nova] Creating event network-vif-plugged:486a8286-8bd4-4826-a629-5c1b4c9df0e1 for instance 54a71380-34c3-40b5-a376-1622f1e44528 on hv-cinder-86248 Oct 24 13:18:20.494776 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-c38694df-2541-48ba-b29c-bed348b07ac7 req-067ac23d-4bea-476c-9e26-b53f5091b23a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060650 Oct 24 13:18:20.496745 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 416/807] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:20.717402 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-d2555c52-2f8c-4e12-9b84-4242fd0e8bc4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:20.720007 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-d2555c52-2f8c-4e12-9b84-4242fd0e8bc4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:20.730649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d2555c52-2f8c-4e12-9b84-4242fd0e8bc4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:20.731166 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d2555c52-2f8c-4e12-9b84-4242fd0e8bc4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:20.731767 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d2555c52-2f8c-4e12-9b84-4242fd0e8bc4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:20.732639 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d2555c52-2f8c-4e12-9b84-4242fd0e8bc4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:20.733253 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d2555c52-2f8c-4e12-9b84-4242fd0e8bc4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:20.733830 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d2555c52-2f8c-4e12-9b84-4242fd0e8bc4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:20.908191 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-d2555c52-2f8c-4e12-9b84-4242fd0e8bc4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:20.914937 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-d2555c52-2f8c-4e12-9b84-4242fd0e8bc4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:20.918042 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-d2555c52-2f8c-4e12-9b84-4242fd0e8bc4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:20.920278 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-d2555c52-2f8c-4e12-9b84-4242fd0e8bc4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1739 microversion: 2.20 time: 0.206567 Oct 24 13:18:20.935587 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 392/808] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:20 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:20.976296 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-02032108-8a7c-4106-b69e-c783babedbb8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:20.977225 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-02032108-8a7c-4106-b69e-c783babedbb8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:20.987499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02032108-8a7c-4106-b69e-c783babedbb8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:20.991240 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02032108-8a7c-4106-b69e-c783babedbb8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:20.992181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02032108-8a7c-4106-b69e-c783babedbb8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:20.993487 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02032108-8a7c-4106-b69e-c783babedbb8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:20.995503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02032108-8a7c-4106-b69e-c783babedbb8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:21.000244 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02032108-8a7c-4106-b69e-c783babedbb8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:21.322902 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-02032108-8a7c-4106-b69e-c783babedbb8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:21.339109 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-02032108-8a7c-4106-b69e-c783babedbb8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc" status: 200 len: 1550 microversion: 2.1 time: 0.369395 Oct 24 13:18:21.352439 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 417/809] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:18:20 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc => generated 1550 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:18:21.379465 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-1d71a7c4-00dd-4a44-b6b9-5030f5149ce8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:21.380875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-1d71a7c4-00dd-4a44-b6b9-5030f5149ce8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:21.388116 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d71a7c4-00dd-4a44-b6b9-5030f5149ce8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:21.388811 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d71a7c4-00dd-4a44-b6b9-5030f5149ce8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:21.394127 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d71a7c4-00dd-4a44-b6b9-5030f5149ce8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:21.397114 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d71a7c4-00dd-4a44-b6b9-5030f5149ce8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:21.398526 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d71a7c4-00dd-4a44-b6b9-5030f5149ce8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:21.399830 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1d71a7c4-00dd-4a44-b6b9-5030f5149ce8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:21.699576 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-1d71a7c4-00dd-4a44-b6b9-5030f5149ce8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.336308 Oct 24 13:18:21.700707 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 393/810] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Oct 24 13:18:21 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-interface => generated 284 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:18:21.948546 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-bb783e4f-85c1-4f6e-96aa-8a4afd0c3b47 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:21.949359 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-bb783e4f-85c1-4f6e-96aa-8a4afd0c3b47 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:21.971601 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bb783e4f-85c1-4f6e-96aa-8a4afd0c3b47 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:21.972282 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bb783e4f-85c1-4f6e-96aa-8a4afd0c3b47 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:21.975954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bb783e4f-85c1-4f6e-96aa-8a4afd0c3b47 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:21.976867 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bb783e4f-85c1-4f6e-96aa-8a4afd0c3b47 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:21.977627 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bb783e4f-85c1-4f6e-96aa-8a4afd0c3b47 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:21.978203 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bb783e4f-85c1-4f6e-96aa-8a4afd0c3b47 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:22.475385 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-bb783e4f-85c1-4f6e-96aa-8a4afd0c3b47 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:22.492006 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-bb783e4f-85c1-4f6e-96aa-8a4afd0c3b47 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:22.501423 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-bb783e4f-85c1-4f6e-96aa-8a4afd0c3b47 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:22.504427 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-bb783e4f-85c1-4f6e-96aa-8a4afd0c3b47 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1739 microversion: 2.20 time: 0.559016 Oct 24 13:18:22.509713 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 418/811] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:21 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1739 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:23.539404 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-51c3b5b0-0afd-49b1-b693-1340145962f2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:23.540020 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-51c3b5b0-0afd-49b1-b693-1340145962f2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:23.550014 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-51c3b5b0-0afd-49b1-b693-1340145962f2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:23.550514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-51c3b5b0-0afd-49b1-b693-1340145962f2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:23.550944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-51c3b5b0-0afd-49b1-b693-1340145962f2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:23.554443 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-51c3b5b0-0afd-49b1-b693-1340145962f2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:23.555122 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-51c3b5b0-0afd-49b1-b693-1340145962f2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:23.557775 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-51c3b5b0-0afd-49b1-b693-1340145962f2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:23.579793 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-dbc33785-ff5c-43d7-906c-5308737154bf req-acd67c96-f6f7-488a-a8fb-1c170cf3c2ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a61a38e-37d5-4a07-8990-10906e3122dc", "tag": "b2e03576-01e9-4c65-aae0-ffd1580274d1"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:23.606340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-dbc33785-ff5c-43d7-906c-5308737154bf req-acd67c96-f6f7-488a-a8fb-1c170cf3c2ac service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:23.606825 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-dbc33785-ff5c-43d7-906c-5308737154bf req-acd67c96-f6f7-488a-a8fb-1c170cf3c2ac service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:23.607283 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-dbc33785-ff5c-43d7-906c-5308737154bf req-acd67c96-f6f7-488a-a8fb-1c170cf3c2ac service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:23.652926 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-dbc33785-ff5c-43d7-906c-5308737154bf req-acd67c96-f6f7-488a-a8fb-1c170cf3c2ac service nova] Creating event network-changed:b2e03576-01e9-4c65-aae0-ffd1580274d1 for instance 4a61a38e-37d5-4a07-8990-10906e3122dc on hv-cinder-86248 Oct 24 13:18:23.667357 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-dbc33785-ff5c-43d7-906c-5308737154bf req-acd67c96-f6f7-488a-a8fb-1c170cf3c2ac service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100543 Oct 24 13:18:23.667959 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 419/812] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 24 13:18:24.458879 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-51c3b5b0-0afd-49b1-b693-1340145962f2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:24.472501 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-51c3b5b0-0afd-49b1-b693-1340145962f2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:24.475780 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-51c3b5b0-0afd-49b1-b693-1340145962f2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:24.480044 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-51c3b5b0-0afd-49b1-b693-1340145962f2 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1739 microversion: 2.20 time: 0.946006 Oct 24 13:18:24.498158 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 394/813] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:23 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1739 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:25.515694 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a9a00edc-3c17-4378-908c-3df7edd9a9ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:25.517005 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a9a00edc-3c17-4378-908c-3df7edd9a9ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:25.536965 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a9a00edc-3c17-4378-908c-3df7edd9a9ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:25.540830 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a9a00edc-3c17-4378-908c-3df7edd9a9ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:25.541294 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a9a00edc-3c17-4378-908c-3df7edd9a9ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:25.542030 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a9a00edc-3c17-4378-908c-3df7edd9a9ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:25.547273 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a9a00edc-3c17-4378-908c-3df7edd9a9ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:25.547907 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a9a00edc-3c17-4378-908c-3df7edd9a9ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:25.846183 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a9a00edc-3c17-4378-908c-3df7edd9a9ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:25.857283 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a9a00edc-3c17-4378-908c-3df7edd9a9ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:25.860347 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a9a00edc-3c17-4378-908c-3df7edd9a9ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:25.863999 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a9a00edc-3c17-4378-908c-3df7edd9a9ef tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1739 microversion: 2.20 time: 0.352707 Oct 24 13:18:25.880040 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 420/814] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:25 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1739 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:26.893138 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-6cd48ca7-0bfa-4c93-a95e-90c36201cffb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:26.894535 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-6cd48ca7-0bfa-4c93-a95e-90c36201cffb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:26.904754 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6cd48ca7-0bfa-4c93-a95e-90c36201cffb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:26.906768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6cd48ca7-0bfa-4c93-a95e-90c36201cffb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:26.907523 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6cd48ca7-0bfa-4c93-a95e-90c36201cffb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:26.919199 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6cd48ca7-0bfa-4c93-a95e-90c36201cffb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:26.920119 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6cd48ca7-0bfa-4c93-a95e-90c36201cffb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:26.922921 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6cd48ca7-0bfa-4c93-a95e-90c36201cffb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:26.971288 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=100 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:27.144346 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-6cd48ca7-0bfa-4c93-a95e-90c36201cffb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:27.159824 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-6cd48ca7-0bfa-4c93-a95e-90c36201cffb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:27.164007 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-6cd48ca7-0bfa-4c93-a95e-90c36201cffb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:27.165435 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-6cd48ca7-0bfa-4c93-a95e-90c36201cffb tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1739 microversion: 2.20 time: 0.277620 Oct 24 13:18:27.169501 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 395/815] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:26 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1739 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:28.197380 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-3948a1e4-3ac0-4b1f-b7d4-af986f4bcd75 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:28.203807 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-3948a1e4-3ac0-4b1f-b7d4-af986f4bcd75 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:28.222095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:28.230273 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3948a1e4-3ac0-4b1f-b7d4-af986f4bcd75 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:28.232218 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3948a1e4-3ac0-4b1f-b7d4-af986f4bcd75 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:28.233443 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3948a1e4-3ac0-4b1f-b7d4-af986f4bcd75 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:28.237588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3948a1e4-3ac0-4b1f-b7d4-af986f4bcd75 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:28.238251 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3948a1e4-3ac0-4b1f-b7d4-af986f4bcd75 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:28.239889 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3948a1e4-3ac0-4b1f-b7d4-af986f4bcd75 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:28.502030 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-3948a1e4-3ac0-4b1f-b7d4-af986f4bcd75 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:28.517946 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-3948a1e4-3ac0-4b1f-b7d4-af986f4bcd75 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:28.519655 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-3948a1e4-3ac0-4b1f-b7d4-af986f4bcd75 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:28.521755 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-3948a1e4-3ac0-4b1f-b7d4-af986f4bcd75 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1739 microversion: 2.20 time: 0.328771 Oct 24 13:18:28.531162 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 421/816] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:28 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1739 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:29.548863 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-13ed9946-da9e-4df5-98b3-7baca4bc257a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:29.549469 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-13ed9946-da9e-4df5-98b3-7baca4bc257a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:29.565197 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-13ed9946-da9e-4df5-98b3-7baca4bc257a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:29.574244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-13ed9946-da9e-4df5-98b3-7baca4bc257a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:29.574697 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-13ed9946-da9e-4df5-98b3-7baca4bc257a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:29.575860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-13ed9946-da9e-4df5-98b3-7baca4bc257a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:29.576325 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-13ed9946-da9e-4df5-98b3-7baca4bc257a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:29.576759 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-13ed9946-da9e-4df5-98b3-7baca4bc257a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:29.886801 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-13ed9946-da9e-4df5-98b3-7baca4bc257a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:29.913925 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-13ed9946-da9e-4df5-98b3-7baca4bc257a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:29.916595 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-13ed9946-da9e-4df5-98b3-7baca4bc257a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:29.918107 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-13ed9946-da9e-4df5-98b3-7baca4bc257a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1739 microversion: 2.20 time: 0.373051 Oct 24 13:18:29.936433 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 396/817] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:29 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1739 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:30.946306 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d6e45dba-7f28-4203-8e3d-f7fe5ddf664b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:30.946918 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-d6e45dba-7f28-4203-8e3d-f7fe5ddf664b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:30.956889 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d6e45dba-7f28-4203-8e3d-f7fe5ddf664b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:30.957382 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d6e45dba-7f28-4203-8e3d-f7fe5ddf664b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:30.958346 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d6e45dba-7f28-4203-8e3d-f7fe5ddf664b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:30.959083 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d6e45dba-7f28-4203-8e3d-f7fe5ddf664b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:30.964767 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d6e45dba-7f28-4203-8e3d-f7fe5ddf664b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:30.965267 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d6e45dba-7f28-4203-8e3d-f7fe5ddf664b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:31.223031 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-d6e45dba-7f28-4203-8e3d-f7fe5ddf664b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:31.236149 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-d6e45dba-7f28-4203-8e3d-f7fe5ddf664b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:31.237855 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-d6e45dba-7f28-4203-8e3d-f7fe5ddf664b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:31.239816 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-d6e45dba-7f28-4203-8e3d-f7fe5ddf664b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1739 microversion: 2.20 time: 0.297243 Oct 24 13:18:31.240569 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 422/818] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:30 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1739 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:32.271884 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-510e31bc-f2cb-4b6b-8b55-386f45d4c0bf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:32.272515 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-510e31bc-f2cb-4b6b-8b55-386f45d4c0bf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:32.278746 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-510e31bc-f2cb-4b6b-8b55-386f45d4c0bf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:32.279270 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-510e31bc-f2cb-4b6b-8b55-386f45d4c0bf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:32.279736 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-510e31bc-f2cb-4b6b-8b55-386f45d4c0bf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:32.280437 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-510e31bc-f2cb-4b6b-8b55-386f45d4c0bf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:32.280892 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-510e31bc-f2cb-4b6b-8b55-386f45d4c0bf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:32.281316 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-510e31bc-f2cb-4b6b-8b55-386f45d4c0bf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:32.449075 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-510e31bc-f2cb-4b6b-8b55-386f45d4c0bf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:32.459723 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-510e31bc-f2cb-4b6b-8b55-386f45d4c0bf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:32.461229 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-510e31bc-f2cb-4b6b-8b55-386f45d4c0bf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:32.462488 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-510e31bc-f2cb-4b6b-8b55-386f45d4c0bf tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1739 microversion: 2.20 time: 0.198887 Oct 24 13:18:32.463701 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 397/819] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:32 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:33.492966 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-10308861-5772-492f-b63b-7a0e74c647b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:33.494823 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-10308861-5772-492f-b63b-7a0e74c647b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:33.503713 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-10308861-5772-492f-b63b-7a0e74c647b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:33.504616 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-10308861-5772-492f-b63b-7a0e74c647b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:33.505467 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-10308861-5772-492f-b63b-7a0e74c647b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:33.506668 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-10308861-5772-492f-b63b-7a0e74c647b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:33.507357 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-10308861-5772-492f-b63b-7a0e74c647b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:33.507783 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-10308861-5772-492f-b63b-7a0e74c647b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:33.673134 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-10308861-5772-492f-b63b-7a0e74c647b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:33.681856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-10308861-5772-492f-b63b-7a0e74c647b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:33.683318 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-10308861-5772-492f-b63b-7a0e74c647b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:33.684489 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-10308861-5772-492f-b63b-7a0e74c647b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1739 microversion: 2.20 time: 0.196911 Oct 24 13:18:33.685046 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 423/820] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:33 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:18:34.709938 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-15d55c86-5ce3-4baa-bedb-192768afb931 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:34.710581 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-15d55c86-5ce3-4baa-bedb-192768afb931 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:34.712919 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=71,nova_api:DELETE=1 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:34.717852 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-15d55c86-5ce3-4baa-bedb-192768afb931 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:34.718347 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-15d55c86-5ce3-4baa-bedb-192768afb931 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:34.718781 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-15d55c86-5ce3-4baa-bedb-192768afb931 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:34.719519 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-15d55c86-5ce3-4baa-bedb-192768afb931 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:34.719969 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-15d55c86-5ce3-4baa-bedb-192768afb931 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:34.720586 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-15d55c86-5ce3-4baa-bedb-192768afb931 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:34.860733 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-15d55c86-5ce3-4baa-bedb-192768afb931 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:34.871211 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-15d55c86-5ce3-4baa-bedb-192768afb931 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:34.872771 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-15d55c86-5ce3-4baa-bedb-192768afb931 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:34.873943 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-15d55c86-5ce3-4baa-bedb-192768afb931 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1721 microversion: 2.20 time: 0.167982 Oct 24 13:18:34.887076 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 398/821] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:34 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:35.901778 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-782a5a83-ebc6-416d-b4aa-1f89a7c488b5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:35.902435 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-782a5a83-ebc6-416d-b4aa-1f89a7c488b5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:35.908780 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-782a5a83-ebc6-416d-b4aa-1f89a7c488b5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:35.909257 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-782a5a83-ebc6-416d-b4aa-1f89a7c488b5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:35.909686 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-782a5a83-ebc6-416d-b4aa-1f89a7c488b5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:35.910374 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-782a5a83-ebc6-416d-b4aa-1f89a7c488b5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:35.911379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-782a5a83-ebc6-416d-b4aa-1f89a7c488b5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:35.911795 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-782a5a83-ebc6-416d-b4aa-1f89a7c488b5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:36.046422 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-782a5a83-ebc6-416d-b4aa-1f89a7c488b5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:36.054618 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-782a5a83-ebc6-416d-b4aa-1f89a7c488b5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:36.056068 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-782a5a83-ebc6-416d-b4aa-1f89a7c488b5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:36.057257 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-782a5a83-ebc6-416d-b4aa-1f89a7c488b5 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1721 microversion: 2.20 time: 0.159472 Oct 24 13:18:36.057792 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 424/822] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:35 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:37.081853 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-d5f179c3-2a2f-4d4a-a24f-9e4ead555a65 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:37.082465 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-d5f179c3-2a2f-4d4a-a24f-9e4ead555a65 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:37.089064 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d5f179c3-2a2f-4d4a-a24f-9e4ead555a65 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:37.089578 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d5f179c3-2a2f-4d4a-a24f-9e4ead555a65 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:37.090015 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d5f179c3-2a2f-4d4a-a24f-9e4ead555a65 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:37.090808 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d5f179c3-2a2f-4d4a-a24f-9e4ead555a65 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:37.091305 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d5f179c3-2a2f-4d4a-a24f-9e4ead555a65 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:37.091723 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d5f179c3-2a2f-4d4a-a24f-9e4ead555a65 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:37.476926 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-d5f179c3-2a2f-4d4a-a24f-9e4ead555a65 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:37.484925 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-d5f179c3-2a2f-4d4a-a24f-9e4ead555a65 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:37.486352 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-d5f179c3-2a2f-4d4a-a24f-9e4ead555a65 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:37.487535 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-d5f179c3-2a2f-4d4a-a24f-9e4ead555a65 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1664 microversion: 2.20 time: 0.409708 Oct 24 13:18:37.488088 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 399/823] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:37 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1664 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:37.512347 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-5bd10e84-12bc-4abb-91a1-dc1340ad6ac9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0988becd-92eb-42f7-a67a-2ee161c291bf"}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:37.514643 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-5bd10e84-12bc-4abb-91a1-dc1340ad6ac9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:37.521635 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5bd10e84-12bc-4abb-91a1-dc1340ad6ac9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:37.522115 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5bd10e84-12bc-4abb-91a1-dc1340ad6ac9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:37.522547 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5bd10e84-12bc-4abb-91a1-dc1340ad6ac9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:37.523260 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5bd10e84-12bc-4abb-91a1-dc1340ad6ac9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:37.523711 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5bd10e84-12bc-4abb-91a1-dc1340ad6ac9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:37.524131 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-5bd10e84-12bc-4abb-91a1-dc1340ad6ac9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:37.786670 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-5bd10e84-12bc-4abb-91a1-dc1340ad6ac9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "POST /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.277729 Oct 24 13:18:37.787288 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 425/824] 10.222.0.42 () {62 vars in 1364 bytes} [Mon Oct 24 13:18:37 2022] POST /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528/os-volume_attachments => generated 188 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 24 13:18:37.910959 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-d8d57b54-d423-4f47-a5e8-fdaace4ec795 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:37.911489 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-d8d57b54-d423-4f47-a5e8-fdaace4ec795 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:37.917333 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d8d57b54-d423-4f47-a5e8-fdaace4ec795 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:37.917811 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d8d57b54-d423-4f47-a5e8-fdaace4ec795 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:37.918244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d8d57b54-d423-4f47-a5e8-fdaace4ec795 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:37.918929 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d8d57b54-d423-4f47-a5e8-fdaace4ec795 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:37.919421 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d8d57b54-d423-4f47-a5e8-fdaace4ec795 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:37.919842 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d8d57b54-d423-4f47-a5e8-fdaace4ec795 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:39.024395 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-d8d57b54-d423-4f47-a5e8-fdaace4ec795 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "DELETE /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528/os-volume_attachments/0988becd-92eb-42f7-a67a-2ee161c291bf" status: 202 len: 0 microversion: 2.20 time: 1.117414 Oct 24 13:18:39.025144 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 400/825] 10.222.0.42 () {60 vars in 1457 bytes} [Mon Oct 24 13:18:37 2022] DELETE /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528/os-volume_attachments/0988becd-92eb-42f7-a67a-2ee161c291bf => generated 0 bytes in 1119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:18:39.087399 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-7c6a1b0e-b252-42d7-b335-7385f0db1f08 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:39.087999 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-7c6a1b0e-b252-42d7-b335-7385f0db1f08 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:39.094360 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7c6a1b0e-b252-42d7-b335-7385f0db1f08 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:39.094837 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7c6a1b0e-b252-42d7-b335-7385f0db1f08 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:39.095304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7c6a1b0e-b252-42d7-b335-7385f0db1f08 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:39.095993 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7c6a1b0e-b252-42d7-b335-7385f0db1f08 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:39.096446 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7c6a1b0e-b252-42d7-b335-7385f0db1f08 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:39.096870 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7c6a1b0e-b252-42d7-b335-7385f0db1f08 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:39.126243 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-7c6a1b0e-b252-42d7-b335-7385f0db1f08 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118914) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 24 13:18:39.193667 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7c6a1b0e-b252-42d7-b335-7385f0db1f08 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [a2a56bf9-7e7a-417c-a81a-c37f812b0106] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 24 13:18:39.969112 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-ae13dc34-f750-4d25-8278-355ef3a32f77 req-9de95176-29c2-47c2-aa9c-c2990e56351f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54a71380-34c3-40b5-a376-1622f1e44528", "name": "network-vif-unplugged", "status": "completed", "tag": "486a8286-8bd4-4826-a629-5c1b4c9df0e1"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:39.982122 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-ae13dc34-f750-4d25-8278-355ef3a32f77 req-9de95176-29c2-47c2-aa9c-c2990e56351f service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:39.982943 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-ae13dc34-f750-4d25-8278-355ef3a32f77 req-9de95176-29c2-47c2-aa9c-c2990e56351f service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:39.983411 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-ae13dc34-f750-4d25-8278-355ef3a32f77 req-9de95176-29c2-47c2-aa9c-c2990e56351f service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:39.993756 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.compute.server_external_events [req-ae13dc34-f750-4d25-8278-355ef3a32f77 req-9de95176-29c2-47c2-aa9c-c2990e56351f service nova] Unable to find a host for instance 54a71380-34c3-40b5-a376-1622f1e44528. Dropping event network-vif-unplugged {{(pid=118915) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 24 13:18:39.994647 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-ae13dc34-f750-4d25-8278-355ef3a32f77 req-9de95176-29c2-47c2-aa9c-c2990e56351f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029881 Oct 24 13:18:39.995269 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 401/826] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 24 13:18:40.200221 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO oslo.messaging._drivers.impl_rabbit [None req-7c6a1b0e-b252-42d7-b335-7385f0db1f08 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [a2a56bf9-7e7a-417c-a81a-c37f812b0106] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 39182. Oct 24 13:18:40.204601 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-7c6a1b0e-b252-42d7-b335-7385f0db1f08 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "POST /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528/action" status: 202 len: 0 microversion: 2.20 time: 1.121102 Oct 24 13:18:40.205980 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 426/827] 10.222.0.42 () {62 vars in 1319 bytes} [Mon Oct 24 13:18:39 2022] POST /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528/action => generated 0 bytes in 1123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:18:40.214551 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-d359a7cb-59b8-4393-b377-de2411d5d542 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:40.215208 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-d359a7cb-59b8-4393-b377-de2411d5d542 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:40.221126 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d359a7cb-59b8-4393-b377-de2411d5d542 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:40.221623 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d359a7cb-59b8-4393-b377-de2411d5d542 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:40.222054 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d359a7cb-59b8-4393-b377-de2411d5d542 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:40.222745 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d359a7cb-59b8-4393-b377-de2411d5d542 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:40.223401 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d359a7cb-59b8-4393-b377-de2411d5d542 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:40.224049 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d359a7cb-59b8-4393-b377-de2411d5d542 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:40.382786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-d359a7cb-59b8-4393-b377-de2411d5d542 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:40.393118 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-d359a7cb-59b8-4393-b377-de2411d5d542 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:40.395704 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-d359a7cb-59b8-4393-b377-de2411d5d542 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:40.397571 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-d359a7cb-59b8-4393-b377-de2411d5d542 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1672 microversion: 2.20 time: 0.186878 Oct 24 13:18:40.398473 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 402/828] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:40 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1672 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:18:41.422413 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-49f57a2b-fafa-4030-83ce-848f7e0734ce tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:41.423028 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-49f57a2b-fafa-4030-83ce-848f7e0734ce tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:41.429385 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-49f57a2b-fafa-4030-83ce-848f7e0734ce tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:41.429864 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-49f57a2b-fafa-4030-83ce-848f7e0734ce tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:41.430290 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-49f57a2b-fafa-4030-83ce-848f7e0734ce tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:41.430982 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-49f57a2b-fafa-4030-83ce-848f7e0734ce tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:41.431451 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-49f57a2b-fafa-4030-83ce-848f7e0734ce tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:41.431964 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-49f57a2b-fafa-4030-83ce-848f7e0734ce tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:41.713982 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-49f57a2b-fafa-4030-83ce-848f7e0734ce tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:41.721847 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-49f57a2b-fafa-4030-83ce-848f7e0734ce tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:41.723977 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-49f57a2b-fafa-4030-83ce-848f7e0734ce tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:41.725115 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-49f57a2b-fafa-4030-83ce-848f7e0734ce tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1730 microversion: 2.20 time: 0.307284 Oct 24 13:18:41.725662 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 427/829] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:41 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1730 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:42.751566 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8120cec3-f272-446e-b176-19163a54f9c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:42.752170 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-8120cec3-f272-446e-b176-19163a54f9c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:42.758899 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8120cec3-f272-446e-b176-19163a54f9c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:42.759435 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8120cec3-f272-446e-b176-19163a54f9c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:42.759870 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8120cec3-f272-446e-b176-19163a54f9c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:42.760809 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8120cec3-f272-446e-b176-19163a54f9c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:42.761273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8120cec3-f272-446e-b176-19163a54f9c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:42.761694 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8120cec3-f272-446e-b176-19163a54f9c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:42.921440 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-8120cec3-f272-446e-b176-19163a54f9c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:42.937012 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-8120cec3-f272-446e-b176-19163a54f9c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:42.938990 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-8120cec3-f272-446e-b176-19163a54f9c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:42.940662 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-8120cec3-f272-446e-b176-19163a54f9c3 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1730 microversion: 2.20 time: 0.193100 Oct 24 13:18:42.941897 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 403/830] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:42 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:18:43.971503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-188c79c7-e9a7-4b55-8a5c-c2512f37a341 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:43.973973 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-188c79c7-e9a7-4b55-8a5c-c2512f37a341 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:43.981197 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-188c79c7-e9a7-4b55-8a5c-c2512f37a341 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:43.981687 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-188c79c7-e9a7-4b55-8a5c-c2512f37a341 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:43.982127 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-188c79c7-e9a7-4b55-8a5c-c2512f37a341 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:43.982828 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-188c79c7-e9a7-4b55-8a5c-c2512f37a341 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:43.983374 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-188c79c7-e9a7-4b55-8a5c-c2512f37a341 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:43.983826 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-188c79c7-e9a7-4b55-8a5c-c2512f37a341 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:44.160967 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-188c79c7-e9a7-4b55-8a5c-c2512f37a341 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:44.173037 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-188c79c7-e9a7-4b55-8a5c-c2512f37a341 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:44.174822 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-188c79c7-e9a7-4b55-8a5c-c2512f37a341 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:44.176442 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-188c79c7-e9a7-4b55-8a5c-c2512f37a341 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1730 microversion: 2.20 time: 0.210186 Oct 24 13:18:44.177147 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 428/831] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:43 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1730 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:45.202362 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-59f7f834-7775-4bdd-a55b-691970661e25 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:45.202965 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-59f7f834-7775-4bdd-a55b-691970661e25 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:45.210464 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-59f7f834-7775-4bdd-a55b-691970661e25 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:45.210937 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-59f7f834-7775-4bdd-a55b-691970661e25 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:45.211396 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-59f7f834-7775-4bdd-a55b-691970661e25 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:45.212073 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-59f7f834-7775-4bdd-a55b-691970661e25 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:45.212543 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-59f7f834-7775-4bdd-a55b-691970661e25 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:45.212958 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-59f7f834-7775-4bdd-a55b-691970661e25 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:45.360149 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-59f7f834-7775-4bdd-a55b-691970661e25 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:45.369682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-59f7f834-7775-4bdd-a55b-691970661e25 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:45.371131 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-59f7f834-7775-4bdd-a55b-691970661e25 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:45.372320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-59f7f834-7775-4bdd-a55b-691970661e25 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1730 microversion: 2.20 time: 0.173827 Oct 24 13:18:45.372886 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 404/832] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:45 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:46.400982 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c0212b65-493d-44cd-a1ee-16e92dd33311 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:46.401593 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-c0212b65-493d-44cd-a1ee-16e92dd33311 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:46.408063 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c0212b65-493d-44cd-a1ee-16e92dd33311 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:46.408546 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c0212b65-493d-44cd-a1ee-16e92dd33311 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:46.408982 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c0212b65-493d-44cd-a1ee-16e92dd33311 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:46.409679 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c0212b65-493d-44cd-a1ee-16e92dd33311 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:46.410135 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c0212b65-493d-44cd-a1ee-16e92dd33311 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:46.411306 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c0212b65-493d-44cd-a1ee-16e92dd33311 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:46.433089 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:46.557698 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-c0212b65-493d-44cd-a1ee-16e92dd33311 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:46.567621 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-c0212b65-493d-44cd-a1ee-16e92dd33311 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:46.569404 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-c0212b65-493d-44cd-a1ee-16e92dd33311 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:46.571045 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-c0212b65-493d-44cd-a1ee-16e92dd33311 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1730 microversion: 2.20 time: 0.174029 Oct 24 13:18:46.578399 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 429/833] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:46 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:47.596511 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-c39d5df2-8256-4b4c-b93a-0238fefffb5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:47.597120 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-c39d5df2-8256-4b4c-b93a-0238fefffb5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:47.603969 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c39d5df2-8256-4b4c-b93a-0238fefffb5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:47.604442 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c39d5df2-8256-4b4c-b93a-0238fefffb5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:47.604869 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c39d5df2-8256-4b4c-b93a-0238fefffb5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:47.605547 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c39d5df2-8256-4b4c-b93a-0238fefffb5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:47.605995 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c39d5df2-8256-4b4c-b93a-0238fefffb5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:47.606416 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c39d5df2-8256-4b4c-b93a-0238fefffb5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:47.744395 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-c39d5df2-8256-4b4c-b93a-0238fefffb5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:47.753038 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-c39d5df2-8256-4b4c-b93a-0238fefffb5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:47.755317 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-c39d5df2-8256-4b4c-b93a-0238fefffb5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:47.756509 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-c39d5df2-8256-4b4c-b93a-0238fefffb5c tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1730 microversion: 2.20 time: 0.163890 Oct 24 13:18:47.757071 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 405/834] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:47 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:48.782974 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-4c0d7318-cf94-40d7-ac0b-690bd65a927a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:48.785024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-4c0d7318-cf94-40d7-ac0b-690bd65a927a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:48.793173 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4c0d7318-cf94-40d7-ac0b-690bd65a927a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:48.793760 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4c0d7318-cf94-40d7-ac0b-690bd65a927a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:48.794297 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4c0d7318-cf94-40d7-ac0b-690bd65a927a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:48.795156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4c0d7318-cf94-40d7-ac0b-690bd65a927a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:48.795618 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4c0d7318-cf94-40d7-ac0b-690bd65a927a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:48.796044 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4c0d7318-cf94-40d7-ac0b-690bd65a927a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:48.957603 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-4c0d7318-cf94-40d7-ac0b-690bd65a927a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:48.966333 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-4c0d7318-cf94-40d7-ac0b-690bd65a927a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:48.976576 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-4c0d7318-cf94-40d7-ac0b-690bd65a927a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:48.978411 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-4c0d7318-cf94-40d7-ac0b-690bd65a927a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1730 microversion: 2.20 time: 0.200314 Oct 24 13:18:48.979629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 430/835] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:48 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:50.004895 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-4cffe2d5-1055-49d2-b4e0-70bfbdf48a44 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:50.007031 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-4cffe2d5-1055-49d2-b4e0-70bfbdf48a44 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:50.015378 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4cffe2d5-1055-49d2-b4e0-70bfbdf48a44 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:50.016206 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4cffe2d5-1055-49d2-b4e0-70bfbdf48a44 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:50.016992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4cffe2d5-1055-49d2-b4e0-70bfbdf48a44 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:50.018029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4cffe2d5-1055-49d2-b4e0-70bfbdf48a44 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:50.018689 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4cffe2d5-1055-49d2-b4e0-70bfbdf48a44 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:50.019361 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4cffe2d5-1055-49d2-b4e0-70bfbdf48a44 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:50.169083 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-4cffe2d5-1055-49d2-b4e0-70bfbdf48a44 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:50.179198 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-4cffe2d5-1055-49d2-b4e0-70bfbdf48a44 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:50.180696 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-4cffe2d5-1055-49d2-b4e0-70bfbdf48a44 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:50.181897 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-4cffe2d5-1055-49d2-b4e0-70bfbdf48a44 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1730 microversion: 2.20 time: 0.181665 Oct 24 13:18:50.182469 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 406/836] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:49 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:51.211310 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-481ea1dc-6e57-4f7c-ace2-1650a04d74da tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:51.212705 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-481ea1dc-6e57-4f7c-ace2-1650a04d74da tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:51.219747 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-481ea1dc-6e57-4f7c-ace2-1650a04d74da tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:51.220241 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-481ea1dc-6e57-4f7c-ace2-1650a04d74da tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:51.220676 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-481ea1dc-6e57-4f7c-ace2-1650a04d74da tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:51.221956 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-481ea1dc-6e57-4f7c-ace2-1650a04d74da tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:51.222896 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-481ea1dc-6e57-4f7c-ace2-1650a04d74da tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:51.226849 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-481ea1dc-6e57-4f7c-ace2-1650a04d74da tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:51.372615 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-481ea1dc-6e57-4f7c-ace2-1650a04d74da tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:51.381438 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-481ea1dc-6e57-4f7c-ace2-1650a04d74da tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:51.382875 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-481ea1dc-6e57-4f7c-ace2-1650a04d74da tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:51.384198 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-481ea1dc-6e57-4f7c-ace2-1650a04d74da tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1730 microversion: 2.20 time: 0.178643 Oct 24 13:18:51.384762 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 431/837] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:51 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:52.409700 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-ccc9710e-67b6-4844-824a-53f25335ea92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:52.410362 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-ccc9710e-67b6-4844-824a-53f25335ea92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:52.416991 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ccc9710e-67b6-4844-824a-53f25335ea92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:52.417471 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ccc9710e-67b6-4844-824a-53f25335ea92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:52.417901 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ccc9710e-67b6-4844-824a-53f25335ea92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:52.418613 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ccc9710e-67b6-4844-824a-53f25335ea92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:52.419081 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ccc9710e-67b6-4844-824a-53f25335ea92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:52.419501 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ccc9710e-67b6-4844-824a-53f25335ea92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:52.529886 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-2f50d9d9-21a8-49d7-b672-dc1e995d7ba0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:52.530450 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-2f50d9d9-21a8-49d7-b672-dc1e995d7ba0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:52.537673 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f50d9d9-21a8-49d7-b672-dc1e995d7ba0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:52.538165 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f50d9d9-21a8-49d7-b672-dc1e995d7ba0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:52.538603 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f50d9d9-21a8-49d7-b672-dc1e995d7ba0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:52.539335 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f50d9d9-21a8-49d7-b672-dc1e995d7ba0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:52.539793 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f50d9d9-21a8-49d7-b672-dc1e995d7ba0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:52.540233 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2f50d9d9-21a8-49d7-b672-dc1e995d7ba0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:52.550408 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-ccc9710e-67b6-4844-824a-53f25335ea92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:52.559245 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-ccc9710e-67b6-4844-824a-53f25335ea92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:52.560663 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-ccc9710e-67b6-4844-824a-53f25335ea92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:52.561814 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-ccc9710e-67b6-4844-824a-53f25335ea92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1730 microversion: 2.20 time: 0.156065 Oct 24 13:18:52.562373 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 407/838] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:52 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:52.564115 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-2f50d9d9-21a8-49d7-b672-dc1e995d7ba0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e/ips" status: 200 len: 149 microversion: 2.1 time: 0.038045 Oct 24 13:18:52.564789 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 432/839] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Oct 24 13:18:52 2022] GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:18:53.588391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-d6960ea4-08b2-46cf-a431-37a8c17989e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:53.589030 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-d6960ea4-08b2-46cf-a431-37a8c17989e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:53.595452 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d6960ea4-08b2-46cf-a431-37a8c17989e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:53.595934 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d6960ea4-08b2-46cf-a431-37a8c17989e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:53.596368 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d6960ea4-08b2-46cf-a431-37a8c17989e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:53.597052 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d6960ea4-08b2-46cf-a431-37a8c17989e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:53.597544 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d6960ea4-08b2-46cf-a431-37a8c17989e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:53.597971 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d6960ea4-08b2-46cf-a431-37a8c17989e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:53.734894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-d6960ea4-08b2-46cf-a431-37a8c17989e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:53.742914 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-d6960ea4-08b2-46cf-a431-37a8c17989e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:53.744379 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-d6960ea4-08b2-46cf-a431-37a8c17989e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:53.745529 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-d6960ea4-08b2-46cf-a431-37a8c17989e0 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1730 microversion: 2.20 time: 0.161137 Oct 24 13:18:53.746093 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 408/840] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:53 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:54.771824 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-19e9b518-ab9f-46ed-87ca-5ac53b2a5168 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:54.772439 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-19e9b518-ab9f-46ed-87ca-5ac53b2a5168 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:54.778742 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19e9b518-ab9f-46ed-87ca-5ac53b2a5168 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:54.779257 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19e9b518-ab9f-46ed-87ca-5ac53b2a5168 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:54.779691 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19e9b518-ab9f-46ed-87ca-5ac53b2a5168 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:54.780371 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19e9b518-ab9f-46ed-87ca-5ac53b2a5168 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:54.780825 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19e9b518-ab9f-46ed-87ca-5ac53b2a5168 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:54.781249 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19e9b518-ab9f-46ed-87ca-5ac53b2a5168 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:54.923413 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-19e9b518-ab9f-46ed-87ca-5ac53b2a5168 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:54.934553 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-19e9b518-ab9f-46ed-87ca-5ac53b2a5168 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:54.936348 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-19e9b518-ab9f-46ed-87ca-5ac53b2a5168 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:54.937472 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-19e9b518-ab9f-46ed-87ca-5ac53b2a5168 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1730 microversion: 2.20 time: 0.169724 Oct 24 13:18:54.938012 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 433/841] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:54 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:54.964143 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-68e2813e-b330-4496-9123-c7f220141023 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9b98bb3-88ea-4e21-9558-45204a655b5f"}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:54.966702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-68e2813e-b330-4496-9123-c7f220141023 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:54.973086 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-68e2813e-b330-4496-9123-c7f220141023 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:54.973565 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-68e2813e-b330-4496-9123-c7f220141023 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:54.974001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-68e2813e-b330-4496-9123-c7f220141023 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:54.974689 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-68e2813e-b330-4496-9123-c7f220141023 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:54.975170 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-68e2813e-b330-4496-9123-c7f220141023 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:54.975596 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-68e2813e-b330-4496-9123-c7f220141023 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:55.106370 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:55.221612 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-68e2813e-b330-4496-9123-c7f220141023 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "POST /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261351 Oct 24 13:18:55.223016 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 409/842] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 24 13:18:54 2022] POST /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:55.964357 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-fe8f26c5-ea77-4c1e-945d-11b67a35f059 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:55.964959 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-fe8f26c5-ea77-4c1e-945d-11b67a35f059 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:55.971469 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fe8f26c5-ea77-4c1e-945d-11b67a35f059 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:55.971951 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fe8f26c5-ea77-4c1e-945d-11b67a35f059 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:55.972397 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fe8f26c5-ea77-4c1e-945d-11b67a35f059 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:55.973184 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fe8f26c5-ea77-4c1e-945d-11b67a35f059 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:55.973629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fe8f26c5-ea77-4c1e-945d-11b67a35f059 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:55.974052 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fe8f26c5-ea77-4c1e-945d-11b67a35f059 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:56.124821 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-fe8f26c5-ea77-4c1e-945d-11b67a35f059 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:56.135182 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-fe8f26c5-ea77-4c1e-945d-11b67a35f059 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:56.137007 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-fe8f26c5-ea77-4c1e-945d-11b67a35f059 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:56.138202 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-fe8f26c5-ea77-4c1e-945d-11b67a35f059 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1730 microversion: 2.20 time: 0.177850 Oct 24 13:18:56.138942 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 434/843] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:55 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:57.166787 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-38f36eac-df7b-4faa-b064-19750a2ac12e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:57.167516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-38f36eac-df7b-4faa-b064-19750a2ac12e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:57.173611 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-38f36eac-df7b-4faa-b064-19750a2ac12e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:57.174081 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-38f36eac-df7b-4faa-b064-19750a2ac12e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:57.174507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-38f36eac-df7b-4faa-b064-19750a2ac12e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:57.175221 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-38f36eac-df7b-4faa-b064-19750a2ac12e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:57.176090 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-38f36eac-df7b-4faa-b064-19750a2ac12e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:57.176237 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-38f36eac-df7b-4faa-b064-19750a2ac12e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:57.303327 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-38f36eac-df7b-4faa-b064-19750a2ac12e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:57.311263 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-38f36eac-df7b-4faa-b064-19750a2ac12e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:57.312680 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-38f36eac-df7b-4faa-b064-19750a2ac12e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:57.313828 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-38f36eac-df7b-4faa-b064-19750a2ac12e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1730 microversion: 2.20 time: 0.151936 Oct 24 13:18:57.314369 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 410/844] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:57 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:58.339429 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-95b3c260-6850-4980-909e-0aabdb28dd33 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:58.339948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-95b3c260-6850-4980-909e-0aabdb28dd33 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:58.342264 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:18:58.348074 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-95b3c260-6850-4980-909e-0aabdb28dd33 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:58.348572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-95b3c260-6850-4980-909e-0aabdb28dd33 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:58.348979 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-95b3c260-6850-4980-909e-0aabdb28dd33 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:58.349671 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-95b3c260-6850-4980-909e-0aabdb28dd33 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:58.350127 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-95b3c260-6850-4980-909e-0aabdb28dd33 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:58.350555 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-95b3c260-6850-4980-909e-0aabdb28dd33 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:58.480087 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-95b3c260-6850-4980-909e-0aabdb28dd33 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:58.488312 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-95b3c260-6850-4980-909e-0aabdb28dd33 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:58.489766 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-95b3c260-6850-4980-909e-0aabdb28dd33 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:58.490920 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-95b3c260-6850-4980-909e-0aabdb28dd33 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1730 microversion: 2.20 time: 0.155614 Oct 24 13:18:58.491501 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 435/845] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:58 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:18:59.516361 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-dd4793ed-0c48-47bc-b891-eb79d9cf97ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:18:59.516971 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-dd4793ed-0c48-47bc-b891-eb79d9cf97ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:18:59.524090 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dd4793ed-0c48-47bc-b891-eb79d9cf97ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:59.524955 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dd4793ed-0c48-47bc-b891-eb79d9cf97ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:59.525390 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dd4793ed-0c48-47bc-b891-eb79d9cf97ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:59.526262 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dd4793ed-0c48-47bc-b891-eb79d9cf97ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:59.526706 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dd4793ed-0c48-47bc-b891-eb79d9cf97ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:59.527149 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dd4793ed-0c48-47bc-b891-eb79d9cf97ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:59.621282 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-ff4bb9ac-21b1-4c1f-8977-b5dd2289fdf3 req-511bec83-7e93-4750-b33c-ecc1926a4862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54a71380-34c3-40b5-a376-1622f1e44528", "name": "network-vif-plugged", "status": "completed", "tag": "486a8286-8bd4-4826-a629-5c1b4c9df0e1"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:18:59.633603 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-ff4bb9ac-21b1-4c1f-8977-b5dd2289fdf3 req-511bec83-7e93-4750-b33c-ecc1926a4862 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:18:59.634055 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-ff4bb9ac-21b1-4c1f-8977-b5dd2289fdf3 req-511bec83-7e93-4750-b33c-ecc1926a4862 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:18:59.634506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-ff4bb9ac-21b1-4c1f-8977-b5dd2289fdf3 req-511bec83-7e93-4750-b33c-ecc1926a4862 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:18:59.647627 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-ff4bb9ac-21b1-4c1f-8977-b5dd2289fdf3 req-511bec83-7e93-4750-b33c-ecc1926a4862 service nova] Creating event network-vif-plugged:486a8286-8bd4-4826-a629-5c1b4c9df0e1 for instance 54a71380-34c3-40b5-a376-1622f1e44528 on hv-cinder-86248 Oct 24 13:18:59.653233 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-ff4bb9ac-21b1-4c1f-8977-b5dd2289fdf3 req-511bec83-7e93-4750-b33c-ecc1926a4862 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035972 Oct 24 13:18:59.654026 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 436/846] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:18:59.670105 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-dd4793ed-0c48-47bc-b891-eb79d9cf97ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:59.678822 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-dd4793ed-0c48-47bc-b891-eb79d9cf97ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:59.680418 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-dd4793ed-0c48-47bc-b891-eb79d9cf97ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:18:59.681468 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-dd4793ed-0c48-47bc-b891-eb79d9cf97ab tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1730 microversion: 2.20 time: 0.168928 Oct 24 13:18:59.682025 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 411/847] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:18:59 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:19:00.708676 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-212d48dc-f35c-4526-a24a-63e70ec5e56a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:00.709387 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-212d48dc-f35c-4526-a24a-63e70ec5e56a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:00.715688 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-212d48dc-f35c-4526-a24a-63e70ec5e56a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:00.716176 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-212d48dc-f35c-4526-a24a-63e70ec5e56a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:00.716615 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-212d48dc-f35c-4526-a24a-63e70ec5e56a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:00.717311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-212d48dc-f35c-4526-a24a-63e70ec5e56a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:00.717770 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-212d48dc-f35c-4526-a24a-63e70ec5e56a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:00.718196 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-212d48dc-f35c-4526-a24a-63e70ec5e56a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:00.854937 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-212d48dc-f35c-4526-a24a-63e70ec5e56a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:00.863283 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-212d48dc-f35c-4526-a24a-63e70ec5e56a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:00.865085 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-212d48dc-f35c-4526-a24a-63e70ec5e56a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:00.866283 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-212d48dc-f35c-4526-a24a-63e70ec5e56a tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1730 microversion: 2.20 time: 0.163089 Oct 24 13:19:00.866916 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 437/848] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:19:00 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:19:01.892521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-e0643030-d1d6-4e00-a763-d6edd88fe9b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:01.893136 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-e0643030-d1d6-4e00-a763-d6edd88fe9b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:01.899740 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e0643030-d1d6-4e00-a763-d6edd88fe9b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:01.900389 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e0643030-d1d6-4e00-a763-d6edd88fe9b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:01.900658 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e0643030-d1d6-4e00-a763-d6edd88fe9b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:01.901386 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e0643030-d1d6-4e00-a763-d6edd88fe9b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:01.901808 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e0643030-d1d6-4e00-a763-d6edd88fe9b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:01.902436 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e0643030-d1d6-4e00-a763-d6edd88fe9b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:02.041844 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-e0643030-d1d6-4e00-a763-d6edd88fe9b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:02.050394 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-e0643030-d1d6-4e00-a763-d6edd88fe9b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:02.052465 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-e0643030-d1d6-4e00-a763-d6edd88fe9b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:02.053663 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-e0643030-d1d6-4e00-a763-d6edd88fe9b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1730 microversion: 2.20 time: 0.165085 Oct 24 13:19:02.054429 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 412/849] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:19:01 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:19:02.883643 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c5300b4b-57c6-45ac-94a9-6204fe152de9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:02.884130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-c5300b4b-57c6-45ac-94a9-6204fe152de9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:02.890816 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c5300b4b-57c6-45ac-94a9-6204fe152de9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:02.891339 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c5300b4b-57c6-45ac-94a9-6204fe152de9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:02.891778 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c5300b4b-57c6-45ac-94a9-6204fe152de9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:02.892460 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c5300b4b-57c6-45ac-94a9-6204fe152de9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:02.892915 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c5300b4b-57c6-45ac-94a9-6204fe152de9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:02.893336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c5300b4b-57c6-45ac-94a9-6204fe152de9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:02.973137 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.objects.instance [None req-c5300b4b-57c6-45ac-94a9-6204fe152de9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lazy-loading 'services' on Instance uuid f52b209f-c997-4d1b-9ecf-a4fdc033b64e {{(pid=118914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:19:03.043217 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-c5300b4b-57c6-45ac-94a9-6204fe152de9 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e/os-volume_attachments/b9b98bb3-88ea-4e21-9558-45204a655b5f" status: 202 len: 0 microversion: 2.1 time: 0.163299 Oct 24 13:19:03.043985 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 438/850] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 24 13:19:02 2022] DELETE /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e/os-volume_attachments/b9b98bb3-88ea-4e21-9558-45204a655b5f => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:19:03.053287 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8bf9659d-1b73-4011-9f2d-c4c901d8fb9e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:03.055608 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-8bf9659d-1b73-4011-9f2d-c4c901d8fb9e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:03.062103 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8bf9659d-1b73-4011-9f2d-c4c901d8fb9e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:03.063382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8bf9659d-1b73-4011-9f2d-c4c901d8fb9e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:03.063828 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8bf9659d-1b73-4011-9f2d-c4c901d8fb9e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:03.064732 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8bf9659d-1b73-4011-9f2d-c4c901d8fb9e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:03.065188 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8bf9659d-1b73-4011-9f2d-c4c901d8fb9e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:03.065605 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8bf9659d-1b73-4011-9f2d-c4c901d8fb9e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:03.082278 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d01d9c23-2641-4a25-8dbc-00753624db92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:03.083206 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-d01d9c23-2641-4a25-8dbc-00753624db92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:03.089504 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d01d9c23-2641-4a25-8dbc-00753624db92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:03.090083 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d01d9c23-2641-4a25-8dbc-00753624db92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:03.090370 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d01d9c23-2641-4a25-8dbc-00753624db92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:03.091088 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d01d9c23-2641-4a25-8dbc-00753624db92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:03.091544 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d01d9c23-2641-4a25-8dbc-00753624db92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:03.092168 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d01d9c23-2641-4a25-8dbc-00753624db92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:03.100702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-8bf9659d-1b73-4011-9f2d-c4c901d8fb9e tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052516 Oct 24 13:19:03.101554 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 413/851] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:19:03 2022] GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:03.230022 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-d01d9c23-2641-4a25-8dbc-00753624db92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:03.237955 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-d01d9c23-2641-4a25-8dbc-00753624db92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:03.239450 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-d01d9c23-2641-4a25-8dbc-00753624db92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:03.240606 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-d01d9c23-2641-4a25-8dbc-00753624db92 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1717 microversion: 2.20 time: 0.163953 Oct 24 13:19:03.241153 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 439/852] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:19:03 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1717 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:19:04.114652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-108f476d-096a-486f-ab20-7fe79720b623 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:04.116940 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-108f476d-096a-486f-ab20-7fe79720b623 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:04.123449 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-108f476d-096a-486f-ab20-7fe79720b623 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:04.123956 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-108f476d-096a-486f-ab20-7fe79720b623 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:04.124400 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-108f476d-096a-486f-ab20-7fe79720b623 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:04.125088 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-108f476d-096a-486f-ab20-7fe79720b623 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:04.125546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-108f476d-096a-486f-ab20-7fe79720b623 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:04.125969 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-108f476d-096a-486f-ab20-7fe79720b623 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:04.154843 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-108f476d-096a-486f-ab20-7fe79720b623 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045016 Oct 24 13:19:04.155422 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 414/853] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:19:04 2022] GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:19:04.218470 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-03d8bc39-c679-49fa-99ee-bb76434d719d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:04.219031 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-03d8bc39-c679-49fa-99ee-bb76434d719d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:04.225879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-03d8bc39-c679-49fa-99ee-bb76434d719d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:04.226358 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-03d8bc39-c679-49fa-99ee-bb76434d719d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:04.226794 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-03d8bc39-c679-49fa-99ee-bb76434d719d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:04.227539 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-03d8bc39-c679-49fa-99ee-bb76434d719d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:04.227986 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-03d8bc39-c679-49fa-99ee-bb76434d719d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:04.228412 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-03d8bc39-c679-49fa-99ee-bb76434d719d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:04.255164 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-03d8bc39-c679-49fa-99ee-bb76434d719d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Going to try to terminate instance {{(pid=118914) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:19:04.332291 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-03d8bc39-c679-49fa-99ee-bb76434d719d tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e" status: 204 len: 0 microversion: 2.1 time: 0.117086 Oct 24 13:19:04.333415 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 440/854] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:19:04 2022] DELETE /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:19:04.341447 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-1a669754-66d5-4d1b-90f1-e29eb55a5df5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:04.342061 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-1a669754-66d5-4d1b-90f1-e29eb55a5df5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:04.349522 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1a669754-66d5-4d1b-90f1-e29eb55a5df5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:04.350001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1a669754-66d5-4d1b-90f1-e29eb55a5df5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:04.350431 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1a669754-66d5-4d1b-90f1-e29eb55a5df5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:04.351159 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1a669754-66d5-4d1b-90f1-e29eb55a5df5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:04.351610 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1a669754-66d5-4d1b-90f1-e29eb55a5df5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:04.352019 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-1a669754-66d5-4d1b-90f1-e29eb55a5df5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:04.485159 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-1a669754-66d5-4d1b-90f1-e29eb55a5df5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:04.493113 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-1a669754-66d5-4d1b-90f1-e29eb55a5df5 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e" status: 200 len: 1680 microversion: 2.1 time: 0.155463 Oct 24 13:19:04.493749 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 415/855] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:04 2022] GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:19:04.884016 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-9220be68-0504-4bec-86e2-4718540a443f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:04.884608 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-9220be68-0504-4bec-86e2-4718540a443f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:04.890830 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9220be68-0504-4bec-86e2-4718540a443f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:04.892029 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9220be68-0504-4bec-86e2-4718540a443f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:04.892464 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9220be68-0504-4bec-86e2-4718540a443f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:04.893160 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9220be68-0504-4bec-86e2-4718540a443f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:04.893703 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9220be68-0504-4bec-86e2-4718540a443f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:04.894180 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9220be68-0504-4bec-86e2-4718540a443f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:04.919268 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-9220be68-0504-4bec-86e2-4718540a443f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/ips" status: 200 len: 145 microversion: 2.1 time: 0.221744 Oct 24 13:19:04.919817 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 441/856] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Oct 24 13:19:04 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/ips => generated 145 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:05.517262 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-e13b3427-1f7b-447b-98cb-6bb07039bbe0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:05.518083 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-e13b3427-1f7b-447b-98cb-6bb07039bbe0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:05.521200 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:SELECT=36 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:05.526159 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e13b3427-1f7b-447b-98cb-6bb07039bbe0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:05.526642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e13b3427-1f7b-447b-98cb-6bb07039bbe0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:05.527099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e13b3427-1f7b-447b-98cb-6bb07039bbe0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:05.527800 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e13b3427-1f7b-447b-98cb-6bb07039bbe0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:05.528288 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e13b3427-1f7b-447b-98cb-6bb07039bbe0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:05.528889 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e13b3427-1f7b-447b-98cb-6bb07039bbe0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:05.665428 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-e13b3427-1f7b-447b-98cb-6bb07039bbe0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:05.674551 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-e13b3427-1f7b-447b-98cb-6bb07039bbe0 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e" status: 200 len: 1680 microversion: 2.1 time: 0.159797 Oct 24 13:19:05.674551 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 416/857] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:05 2022] GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:19:06.288520 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-04e1ee82-bf3b-4d01-829c-63266e798779 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9384d8fa-40a6-42ee-8706-e285ea339490"}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:19:06.294974 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-04e1ee82-bf3b-4d01-829c-63266e798779 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:06.307397 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-04e1ee82-bf3b-4d01-829c-63266e798779 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:06.307992 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-04e1ee82-bf3b-4d01-829c-63266e798779 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:06.309181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-04e1ee82-bf3b-4d01-829c-63266e798779 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:06.309952 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-04e1ee82-bf3b-4d01-829c-63266e798779 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:06.310450 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-04e1ee82-bf3b-4d01-829c-63266e798779 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:06.310885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-04e1ee82-bf3b-4d01-829c-63266e798779 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:06.596872 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-04e1ee82-bf3b-4d01-829c-63266e798779 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "POST /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315626 Oct 24 13:19:06.597880 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 442/858] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 24 13:19:06 2022] POST /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:06.702430 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-40eddd18-7e0e-4ad3-a937-204b1ea60993 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:06.703416 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-40eddd18-7e0e-4ad3-a937-204b1ea60993 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:06.710990 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-40eddd18-7e0e-4ad3-a937-204b1ea60993 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:06.711561 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-40eddd18-7e0e-4ad3-a937-204b1ea60993 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:06.712211 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-40eddd18-7e0e-4ad3-a937-204b1ea60993 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:06.712923 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-40eddd18-7e0e-4ad3-a937-204b1ea60993 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:06.713412 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-40eddd18-7e0e-4ad3-a937-204b1ea60993 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:06.713873 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-40eddd18-7e0e-4ad3-a937-204b1ea60993 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:06.792542 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-40eddd18-7e0e-4ad3-a937-204b1ea60993 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5619c8183e04e1d9073f1b40e057967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69beb82dd21b447d8a784e0570c4323c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:06.801099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-40eddd18-7e0e-4ad3-a937-204b1ea60993 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e" status: 200 len: 1613 microversion: 2.1 time: 0.107552 Oct 24 13:19:06.802103 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 417/859] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:06 2022] GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e => generated 1613 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:19:06.966014 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-841d08d8-0e50-4dfa-a561-18202d41bff5 req-252899aa-9435-43a8-bf56-b2e6a9e03980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f52b209f-c997-4d1b-9ecf-a4fdc033b64e", "name": "network-vif-deleted", "tag": "170c174e-102a-43bf-931e-57ccc699cfd2"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:19:06.986178 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-841d08d8-0e50-4dfa-a561-18202d41bff5 req-252899aa-9435-43a8-bf56-b2e6a9e03980 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:06.988932 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-841d08d8-0e50-4dfa-a561-18202d41bff5 req-252899aa-9435-43a8-bf56-b2e6a9e03980 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:06.989613 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-841d08d8-0e50-4dfa-a561-18202d41bff5 req-252899aa-9435-43a8-bf56-b2e6a9e03980 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:07.005334 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-841d08d8-0e50-4dfa-a561-18202d41bff5 req-252899aa-9435-43a8-bf56-b2e6a9e03980 service nova] Creating event network-vif-deleted:170c174e-102a-43bf-931e-57ccc699cfd2 for instance f52b209f-c997-4d1b-9ecf-a4fdc033b64e on hv-cinder-86248 Oct 24 13:19:07.013879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-841d08d8-0e50-4dfa-a561-18202d41bff5 req-252899aa-9435-43a8-bf56-b2e6a9e03980 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052232 Oct 24 13:19:07.014742 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 443/860] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:07.826170 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-d6d601b1-9f8c-4e98-a6d5-e38fa3e09c91 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:07.826791 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-d6d601b1-9f8c-4e98-a6d5-e38fa3e09c91 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:07.833508 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d6d601b1-9f8c-4e98-a6d5-e38fa3e09c91 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:07.834000 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d6d601b1-9f8c-4e98-a6d5-e38fa3e09c91 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:07.834436 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d6d601b1-9f8c-4e98-a6d5-e38fa3e09c91 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:07.835359 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d6d601b1-9f8c-4e98-a6d5-e38fa3e09c91 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:07.836005 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d6d601b1-9f8c-4e98-a6d5-e38fa3e09c91 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:07.836433 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d6d601b1-9f8c-4e98-a6d5-e38fa3e09c91 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:07.851797 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-d6d601b1-9f8c-4e98-a6d5-e38fa3e09c91 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] HTTP exception thrown: Instance f52b209f-c997-4d1b-9ecf-a4fdc033b64e could not be found. Oct 24 13:19:07.853463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-d6d601b1-9f8c-4e98-a6d5-e38fa3e09c91 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Request method failure captured: Oct 24 13:19:07.853463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e HTTP/1.1 Oct 24 13:19:07.853463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:19:07.853463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:19:07.853463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:19:07.853463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:19:07.853463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:19:07.853463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:19:07.853463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:19:07.853463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:19:07.853463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo9AXwMG0aRbejat92eCxhMJFSv0y7_lNyhuCUN6zXnDHpFGdG48-ggi2-Do-PEfXVv_XARCMCP2kZbyq19slbwuuFeg54REDqUjfIH_fbN8NXKvJLHQXv8L_GOaWATBtTB6QuD_0kWnm_UJtW2Xnio6IxEqQIshhCCIfC1pGYUCOsE Oct 24 13:19:07.853463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:19:07.853463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:19:07.853463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:19:07.853463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:19:07.853463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:19:07.853463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:19:07.853463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:19:07.853463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:07.853463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:19:07.853463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:19:07.855229 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:19:07.855229 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:07.855229 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:19:07.855229 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:07.855229 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:19:07.855229 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:19:07.855229 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:19:07.855229 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: c5619c8183e04e1d9073f1b40e057967 Oct 24 13:19:07.855229 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:19:07.855229 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:19:07.855229 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Instance f52b209f-c997-4d1b-9ecf-a4fdc033b64e could not be found. Oct 24 13:19:07.855229 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': 'f52b209f-c997-4d1b-9ecf-a4fdc033b64e'} Oct 24 13:19:07.856150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:07.856150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:07.856150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:19:07.856150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:19:07.856150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:19:07.856150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:19:07.856150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:19:07.856150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:19:07.856150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:19:07.856150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:19:07.856150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f52b209f-c997-4d1b-9ecf-a4fdc033b64e could not be found. Oct 24 13:19:07.856150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:07.856150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:07.856150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:07.856150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:07.856150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:07.856150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:07.856150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:07.856150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:07.856150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:07.857588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:07.857588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:19:07.857588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:19:07.857588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:19:07.857588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:19:07.857588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:19:07.857588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:07.857588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f52b209f-c997-4d1b-9ecf-a4fdc033b64e could not be found. Oct 24 13:19:07.857588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:07.857588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:07.857588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:07.857588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:07.857588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:07.857588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:07.857588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:07.857588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:07.857588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f52b209f-c997-4d1b-9ecf-a4fdc033b64e could not be found. Oct 24 13:19:07.857588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:07.859330 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-d6d601b1-9f8c-4e98-a6d5-e38fa3e09c91 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Returning 404 to user: Instance f52b209f-c997-4d1b-9ecf-a4fdc033b64e could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:07.859330 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-d6d601b1-9f8c-4e98-a6d5-e38fa3e09c91 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e" status: 404 len: 111 microversion: 2.1 time: 0.032913 Oct 24 13:19:07.859507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 418/861] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:07 2022] GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:19:07.866030 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-bfec1c22-8566-47fa-8c14-51d47069a5f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '.version_select at 0x7fad283eef70>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:07.887901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-bfec1c22-8566-47fa-8c14-51d47069a5f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-152508036" status: 202 len: 0 microversion: 2.1 time: 0.027059 Oct 24 13:19:07.888485 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 444/862] 10.222.0.42 () {58 vars in 1218 bytes} [Mon Oct 24 13:19:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-152508036 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:19:09.669831 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-4e5c74e4-4bba-4754-906f-1efc2eaa08b6 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:09.670336 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-4e5c74e4-4bba-4754-906f-1efc2eaa08b6 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:09.677469 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4e5c74e4-4bba-4754-906f-1efc2eaa08b6 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:09.678058 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4e5c74e4-4bba-4754-906f-1efc2eaa08b6 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:09.678502 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4e5c74e4-4bba-4754-906f-1efc2eaa08b6 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:09.679266 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4e5c74e4-4bba-4754-906f-1efc2eaa08b6 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:09.679794 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4e5c74e4-4bba-4754-906f-1efc2eaa08b6 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:09.680216 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-4e5c74e4-4bba-4754-906f-1efc2eaa08b6 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:09.694782 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-4e5c74e4-4bba-4754-906f-1efc2eaa08b6 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] HTTP exception thrown: Instance f52b209f-c997-4d1b-9ecf-a4fdc033b64e could not be found. Oct 24 13:19:09.699391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-4e5c74e4-4bba-4754-906f-1efc2eaa08b6 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Request method failure captured: Oct 24 13:19:09.699391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: DELETE /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e HTTP/1.1 Oct 24 13:19:09.699391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:19:09.699391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:19:09.699391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:19:09.699391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:19:09.699391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:19:09.699391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:19:09.699391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:19:09.699391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:19:09.699391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo9AXwMG0aRbejat92eCxhMJFSv0y7_lNyhuCUN6zXnDHpFGdG48-ggi2-Do-PEfXVv_XARCMCP2kZbyq19slbwuuFeg54REDqUjfIH_fbN8NXKvJLHQXv8L_GOaWATBtTB6QuD_0kWnm_UJtW2Xnio6IxEqQIshhCCIfC1pGYUCOsE Oct 24 13:19:09.699391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:19:09.699391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:19:09.699391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:19:09.699391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:19:09.699391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:19:09.699391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:19:09.699391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:19:09.699391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:09.699391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:19:09.699391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:19:09.700778 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:19:09.700778 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:09.700778 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:19:09.700778 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:09.700778 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:19:09.700778 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:19:09.700778 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:19:09.700778 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: c5619c8183e04e1d9073f1b40e057967 Oct 24 13:19:09.700778 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:19:09.700778 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:19:09.700778 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Instance f52b209f-c997-4d1b-9ecf-a4fdc033b64e could not be found. Oct 24 13:19:09.700778 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': 'f52b209f-c997-4d1b-9ecf-a4fdc033b64e'} Oct 24 13:19:09.701649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:09.701649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:09.701649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:19:09.701649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:19:09.701649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:19:09.701649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:19:09.701649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:19:09.701649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:19:09.701649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:19:09.701649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:19:09.701649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f52b209f-c997-4d1b-9ecf-a4fdc033b64e could not be found. Oct 24 13:19:09.701649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:09.701649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:09.701649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:09.701649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:09.701649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:09.701649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:09.701649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:09.701649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:09.701649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:09.702850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:09.702850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:19:09.702850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:19:09.702850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:19:09.702850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:19:09.702850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:19:09.702850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:19:09.702850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:19:09.702850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:09.702850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f52b209f-c997-4d1b-9ecf-a4fdc033b64e could not be found. Oct 24 13:19:09.702850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:09.702850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:09.702850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:09.702850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:09.702850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:09.702850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:09.702850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:09.702850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:09.702850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f52b209f-c997-4d1b-9ecf-a4fdc033b64e could not be found. Oct 24 13:19:09.702850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:09.704106 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-4e5c74e4-4bba-4754-906f-1efc2eaa08b6 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Returning 404 to user: Instance f52b209f-c997-4d1b-9ecf-a4fdc033b64e could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:09.704106 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-4e5c74e4-4bba-4754-906f-1efc2eaa08b6 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e" status: 404 len: 111 microversion: 2.1 time: 0.034902 Oct 24 13:19:09.704106 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 419/863] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:19:09 2022] DELETE /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:19:09.710281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-43e710f4-366a-4351-acf1-e85fe2b53d72 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:09.711015 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-43e710f4-366a-4351-acf1-e85fe2b53d72 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: f52b209f-c997-4d1b-9ecf-a4fdc033b64e] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:09.718346 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-43e710f4-366a-4351-acf1-e85fe2b53d72 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:09.718891 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-43e710f4-366a-4351-acf1-e85fe2b53d72 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:09.719356 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-43e710f4-366a-4351-acf1-e85fe2b53d72 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:09.720125 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-43e710f4-366a-4351-acf1-e85fe2b53d72 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:09.720579 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-43e710f4-366a-4351-acf1-e85fe2b53d72 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:09.721006 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-43e710f4-366a-4351-acf1-e85fe2b53d72 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:09.725420 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:09.735399 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-43e710f4-366a-4351-acf1-e85fe2b53d72 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] HTTP exception thrown: Instance f52b209f-c997-4d1b-9ecf-a4fdc033b64e could not be found. Oct 24 13:19:09.737095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-43e710f4-366a-4351-acf1-e85fe2b53d72 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Request method failure captured: Oct 24 13:19:09.737095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e HTTP/1.1 Oct 24 13:19:09.737095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:19:09.737095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:19:09.737095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:19:09.737095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:19:09.737095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:19:09.737095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:19:09.737095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:19:09.737095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:19:09.737095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVo9AXwMG0aRbejat92eCxhMJFSv0y7_lNyhuCUN6zXnDHpFGdG48-ggi2-Do-PEfXVv_XARCMCP2kZbyq19slbwuuFeg54REDqUjfIH_fbN8NXKvJLHQXv8L_GOaWATBtTB6QuD_0kWnm_UJtW2Xnio6IxEqQIshhCCIfC1pGYUCOsE Oct 24 13:19:09.737095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:19:09.737095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:19:09.737095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:19:09.737095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:19:09.737095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:19:09.737095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:19:09.737095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:19:09.737095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:09.737095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:19:09.737095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:19:09.739151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:19:09.739151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:09.739151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:19:09.739151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:09.739151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:19:09.739151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:19:09.739151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:19:09.739151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: c5619c8183e04e1d9073f1b40e057967 Oct 24 13:19:09.739151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:19:09.739151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:19:09.739151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Instance f52b209f-c997-4d1b-9ecf-a4fdc033b64e could not be found. Oct 24 13:19:09.739151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': 'f52b209f-c997-4d1b-9ecf-a4fdc033b64e'} Oct 24 13:19:09.739901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:09.739901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:09.739901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:19:09.739901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:19:09.739901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:19:09.739901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:19:09.739901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:19:09.739901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:19:09.739901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:19:09.739901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:19:09.739901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f52b209f-c997-4d1b-9ecf-a4fdc033b64e could not be found. Oct 24 13:19:09.739901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:09.739901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:09.739901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:09.739901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:09.739901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:09.739901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:09.739901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:09.739901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:09.739901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:09.741721 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:09.741721 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:19:09.741721 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:19:09.741721 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:19:09.741721 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:19:09.741721 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:19:09.741721 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:09.741721 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f52b209f-c997-4d1b-9ecf-a4fdc033b64e could not be found. Oct 24 13:19:09.741721 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:09.741721 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:09.741721 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:09.741721 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:09.741721 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:09.741721 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:09.741721 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:09.741721 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:09.741721 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f52b209f-c997-4d1b-9ecf-a4fdc033b64e could not be found. Oct 24 13:19:09.741721 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:09.742961 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-43e710f4-366a-4351-acf1-e85fe2b53d72 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Returning 404 to user: Instance f52b209f-c997-4d1b-9ecf-a4fdc033b64e could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:09.742961 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-43e710f4-366a-4351-acf1-e85fe2b53d72 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e" status: 404 len: 111 microversion: 2.1 time: 0.032813 Oct 24 13:19:09.742961 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 445/864] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:09 2022] GET /compute/v2.1/servers/f52b209f-c997-4d1b-9ecf-a4fdc033b64e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:19:10.885375 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8f77af6b-566c-43e9-bfb5-53249a953369 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:10.886112 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-8f77af6b-566c-43e9-bfb5-53249a953369 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:10.892349 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8f77af6b-566c-43e9-bfb5-53249a953369 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:10.892835 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8f77af6b-566c-43e9-bfb5-53249a953369 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:10.893272 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8f77af6b-566c-43e9-bfb5-53249a953369 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:10.893972 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8f77af6b-566c-43e9-bfb5-53249a953369 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:10.894426 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8f77af6b-566c-43e9-bfb5-53249a953369 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:10.894840 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8f77af6b-566c-43e9-bfb5-53249a953369 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:10.910008 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-8f77af6b-566c-43e9-bfb5-53249a953369 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] HTTP exception thrown: Instance d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 could not be found. Oct 24 13:19:10.912050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8f77af6b-566c-43e9-bfb5-53249a953369 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Request method failure captured: Oct 24 13:19:10.912050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: DELETE /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 HTTP/1.1 Oct 24 13:19:10.912050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:19:10.912050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:19:10.912050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:19:10.912050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:19:10.912050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:19:10.912050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:19:10.912050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:19:10.912050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:19:10.912050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo9AXwMG0aRbejat92eCxhMJFSv0y7_lNyhuCUN6zXnDHpFGdG48-ggi2-Do-PEfXVv_XARCMCP2kZbyq19slbwuuFeg54REDqUjfIH_fbN8NXKvJLHQXv8L_GOaWATBtTB6QuD_0kWnm_UJtW2Xnio6IxEqQIshhCCIfC1pGYUCOsE Oct 24 13:19:10.912050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:19:10.912050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:19:10.912050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:19:10.912050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:19:10.912050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:19:10.912050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:19:10.912050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:19:10.912050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:10.912050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:19:10.912050 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:19:10.913465 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:19:10.913465 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:10.913465 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:19:10.913465 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:10.913465 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:19:10.913465 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:19:10.913465 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:19:10.913465 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: c5619c8183e04e1d9073f1b40e057967 Oct 24 13:19:10.913465 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:19:10.913465 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:19:10.913465 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Instance d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 could not be found. Oct 24 13:19:10.913465 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': 'd1f32388-2b31-4b4f-be1e-1a6b04ce35a5'} Oct 24 13:19:10.914320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:10.914320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:10.914320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:19:10.914320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:19:10.914320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:19:10.914320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:19:10.914320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:19:10.914320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:19:10.914320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:19:10.914320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:19:10.914320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 could not be found. Oct 24 13:19:10.914320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:10.914320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:10.914320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:10.914320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:10.914320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:10.914320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:10.914320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:10.914320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:10.914320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:10.915875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:10.915875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:19:10.915875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:19:10.915875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:19:10.915875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:19:10.915875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:19:10.915875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:19:10.915875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:19:10.915875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:10.915875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 could not be found. Oct 24 13:19:10.915875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:10.915875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:10.915875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:10.915875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:10.915875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:10.915875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:10.915875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:10.915875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:10.915875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 could not be found. Oct 24 13:19:10.915875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:10.917853 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8f77af6b-566c-43e9-bfb5-53249a953369 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Returning 404 to user: Instance d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:10.917853 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-8f77af6b-566c-43e9-bfb5-53249a953369 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5" status: 404 len: 111 microversion: 2.1 time: 0.031944 Oct 24 13:19:10.917853 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 420/865] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:19:10 2022] DELETE /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:19:10.922116 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d6883b25-bdd9-4fc1-8ac1-79828a80ad55 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:10.923271 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-d6883b25-bdd9-4fc1-8ac1-79828a80ad55 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: d1f32388-2b31-4b4f-be1e-1a6b04ce35a5] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:10.933346 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d6883b25-bdd9-4fc1-8ac1-79828a80ad55 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:10.934057 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d6883b25-bdd9-4fc1-8ac1-79828a80ad55 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:10.934683 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d6883b25-bdd9-4fc1-8ac1-79828a80ad55 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:10.935599 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d6883b25-bdd9-4fc1-8ac1-79828a80ad55 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:10.936187 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d6883b25-bdd9-4fc1-8ac1-79828a80ad55 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:10.936623 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d6883b25-bdd9-4fc1-8ac1-79828a80ad55 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:10.953406 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-d6883b25-bdd9-4fc1-8ac1-79828a80ad55 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] HTTP exception thrown: Instance d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 could not be found. Oct 24 13:19:10.954924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d6883b25-bdd9-4fc1-8ac1-79828a80ad55 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Request method failure captured: Oct 24 13:19:10.954924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 HTTP/1.1 Oct 24 13:19:10.954924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:19:10.954924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:19:10.954924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:19:10.954924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:19:10.954924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:19:10.954924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:19:10.954924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:19:10.954924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:19:10.954924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVo9AXwMG0aRbejat92eCxhMJFSv0y7_lNyhuCUN6zXnDHpFGdG48-ggi2-Do-PEfXVv_XARCMCP2kZbyq19slbwuuFeg54REDqUjfIH_fbN8NXKvJLHQXv8L_GOaWATBtTB6QuD_0kWnm_UJtW2Xnio6IxEqQIshhCCIfC1pGYUCOsE Oct 24 13:19:10.954924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:19:10.954924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:19:10.954924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:19:10.954924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:19:10.954924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:19:10.954924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:19:10.954924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:19:10.954924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:10.954924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:19:10.954924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:19:10.956377 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:19:10.956377 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:10.956377 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:19:10.956377 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:10.956377 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:19:10.956377 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:19:10.956377 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:19:10.956377 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: c5619c8183e04e1d9073f1b40e057967 Oct 24 13:19:10.956377 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:19:10.956377 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:19:10.956377 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Instance d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 could not be found. Oct 24 13:19:10.956377 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': 'd1f32388-2b31-4b4f-be1e-1a6b04ce35a5'} Oct 24 13:19:10.957311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:10.957311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:10.957311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:19:10.957311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:19:10.957311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:19:10.957311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:19:10.957311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:19:10.957311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:19:10.957311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:19:10.957311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:19:10.957311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 could not be found. Oct 24 13:19:10.957311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:10.957311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:10.957311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:10.957311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:10.957311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:10.957311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:10.957311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:10.957311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:10.957311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:10.958549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:10.958549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:19:10.958549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:19:10.958549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:19:10.958549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:19:10.958549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:19:10.958549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:10.958549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 could not be found. Oct 24 13:19:10.958549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:10.958549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:10.958549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:10.958549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:10.958549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:10.958549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:10.958549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:10.958549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:10.958549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 could not be found. Oct 24 13:19:10.958549 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:10.959754 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d6883b25-bdd9-4fc1-8ac1-79828a80ad55 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Returning 404 to user: Instance d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:10.959754 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-d6883b25-bdd9-4fc1-8ac1-79828a80ad55 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5" status: 404 len: 111 microversion: 2.1 time: 0.038042 Oct 24 13:19:10.959754 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 446/866] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:10 2022] GET /compute/v2.1/servers/d1f32388-2b31-4b4f-be1e-1a6b04ce35a5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:19:10.966850 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8e7c637b-615d-4952-910a-95760782abe8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:10.967595 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-8e7c637b-615d-4952-910a-95760782abe8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:10.974986 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8e7c637b-615d-4952-910a-95760782abe8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:10.975631 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8e7c637b-615d-4952-910a-95760782abe8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:10.976065 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8e7c637b-615d-4952-910a-95760782abe8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:10.976773 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8e7c637b-615d-4952-910a-95760782abe8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:10.977231 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8e7c637b-615d-4952-910a-95760782abe8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:10.977658 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8e7c637b-615d-4952-910a-95760782abe8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:10.993702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-8e7c637b-615d-4952-910a-95760782abe8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] HTTP exception thrown: Instance dc138711-ddfb-4b61-bf88-532641a857cd could not be found. Oct 24 13:19:10.995302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8e7c637b-615d-4952-910a-95760782abe8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Request method failure captured: Oct 24 13:19:10.995302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: DELETE /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd HTTP/1.1 Oct 24 13:19:10.995302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:19:10.995302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:19:10.995302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:19:10.995302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:19:10.995302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:19:10.995302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:19:10.995302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:19:10.995302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:19:10.995302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo9AXwMG0aRbejat92eCxhMJFSv0y7_lNyhuCUN6zXnDHpFGdG48-ggi2-Do-PEfXVv_XARCMCP2kZbyq19slbwuuFeg54REDqUjfIH_fbN8NXKvJLHQXv8L_GOaWATBtTB6QuD_0kWnm_UJtW2Xnio6IxEqQIshhCCIfC1pGYUCOsE Oct 24 13:19:10.995302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:19:10.995302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:19:10.995302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:19:10.995302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:19:10.995302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:19:10.995302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:19:10.995302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:19:10.995302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:10.995302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:19:10.995302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:19:10.997845 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:19:10.997845 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:10.997845 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:19:10.997845 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:10.997845 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:19:10.997845 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:19:10.997845 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:19:10.997845 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: c5619c8183e04e1d9073f1b40e057967 Oct 24 13:19:10.997845 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:19:10.997845 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:19:10.997845 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Instance dc138711-ddfb-4b61-bf88-532641a857cd could not be found. Oct 24 13:19:10.997845 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': 'dc138711-ddfb-4b61-bf88-532641a857cd'} Oct 24 13:19:11.012910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:11.012910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:11.012910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:19:11.012910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:19:11.012910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:19:11.012910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:19:11.012910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:19:11.012910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:19:11.012910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:19:11.012910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:19:11.012910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc138711-ddfb-4b61-bf88-532641a857cd could not be found. Oct 24 13:19:11.012910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:11.012910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:11.012910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:11.012910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:11.012910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:11.012910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:11.012910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:11.012910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:11.012910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:11.014514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:11.014514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:19:11.014514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:19:11.014514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:19:11.014514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:19:11.014514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:19:11.014514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:19:11.014514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:19:11.014514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:11.014514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc138711-ddfb-4b61-bf88-532641a857cd could not be found. Oct 24 13:19:11.014514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:11.014514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:11.014514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:11.014514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:11.014514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:11.014514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:11.014514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:11.014514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:11.014514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc138711-ddfb-4b61-bf88-532641a857cd could not be found. Oct 24 13:19:11.014514 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:11.016123 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8e7c637b-615d-4952-910a-95760782abe8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Returning 404 to user: Instance dc138711-ddfb-4b61-bf88-532641a857cd could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:11.016123 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-8e7c637b-615d-4952-910a-95760782abe8 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 404 len: 111 microversion: 2.1 time: 0.034502 Oct 24 13:19:11.016123 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 421/867] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:19:10 2022] DELETE /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:19:11.016414 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-ffc38dee-07ad-4c7b-96cb-9edba4afa71b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:11.016414 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-ffc38dee-07ad-4c7b-96cb-9edba4afa71b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: dc138711-ddfb-4b61-bf88-532641a857cd] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:11.016414 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ffc38dee-07ad-4c7b-96cb-9edba4afa71b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:11.016414 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ffc38dee-07ad-4c7b-96cb-9edba4afa71b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:11.016732 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ffc38dee-07ad-4c7b-96cb-9edba4afa71b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:11.016732 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ffc38dee-07ad-4c7b-96cb-9edba4afa71b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:11.016732 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ffc38dee-07ad-4c7b-96cb-9edba4afa71b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:11.016732 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ffc38dee-07ad-4c7b-96cb-9edba4afa71b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:11.032501 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-ffc38dee-07ad-4c7b-96cb-9edba4afa71b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] HTTP exception thrown: Instance dc138711-ddfb-4b61-bf88-532641a857cd could not be found. Oct 24 13:19:11.034130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-ffc38dee-07ad-4c7b-96cb-9edba4afa71b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Request method failure captured: Oct 24 13:19:11.034130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd HTTP/1.1 Oct 24 13:19:11.034130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:19:11.034130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:19:11.034130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:19:11.034130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:19:11.034130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:19:11.034130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:19:11.034130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:19:11.034130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:19:11.034130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVo9AXwMG0aRbejat92eCxhMJFSv0y7_lNyhuCUN6zXnDHpFGdG48-ggi2-Do-PEfXVv_XARCMCP2kZbyq19slbwuuFeg54REDqUjfIH_fbN8NXKvJLHQXv8L_GOaWATBtTB6QuD_0kWnm_UJtW2Xnio6IxEqQIshhCCIfC1pGYUCOsE Oct 24 13:19:11.034130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:19:11.034130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:19:11.034130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:19:11.034130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:19:11.034130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:19:11.034130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:19:11.034130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:19:11.034130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:11.034130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:19:11.034130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:19:11.036970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:19:11.036970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:11.036970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:19:11.036970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:11.036970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:19:11.036970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:19:11.036970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:19:11.036970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: c5619c8183e04e1d9073f1b40e057967 Oct 24 13:19:11.036970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:19:11.036970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:19:11.036970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Instance dc138711-ddfb-4b61-bf88-532641a857cd could not be found. Oct 24 13:19:11.036970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': 'dc138711-ddfb-4b61-bf88-532641a857cd'} Oct 24 13:19:11.037935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:11.037935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:11.037935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:19:11.037935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:19:11.037935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:19:11.037935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:19:11.037935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:19:11.037935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:19:11.037935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:19:11.037935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:19:11.037935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc138711-ddfb-4b61-bf88-532641a857cd could not be found. Oct 24 13:19:11.037935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:11.037935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:11.037935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:11.037935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:11.037935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:11.037935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:11.037935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:11.037935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:11.037935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:11.039831 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:11.039831 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:19:11.039831 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:19:11.039831 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:19:11.039831 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:19:11.039831 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:19:11.039831 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:11.039831 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc138711-ddfb-4b61-bf88-532641a857cd could not be found. Oct 24 13:19:11.039831 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:11.039831 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:11.039831 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:11.039831 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:11.039831 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:11.039831 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:11.039831 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:11.039831 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:11.039831 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc138711-ddfb-4b61-bf88-532641a857cd could not be found. Oct 24 13:19:11.039831 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:11.042947 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-ffc38dee-07ad-4c7b-96cb-9edba4afa71b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Returning 404 to user: Instance dc138711-ddfb-4b61-bf88-532641a857cd could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:11.042947 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-ffc38dee-07ad-4c7b-96cb-9edba4afa71b tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd" status: 404 len: 111 microversion: 2.1 time: 0.034554 Oct 24 13:19:11.042947 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 447/868] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:11 2022] GET /compute/v2.1/servers/dc138711-ddfb-4b61-bf88-532641a857cd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:19:12.192623 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9ee327a8-89c3-4f48-9268-669d28bff412 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:12.193248 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9ee327a8-89c3-4f48-9268-669d28bff412 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:12.199294 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9ee327a8-89c3-4f48-9268-669d28bff412 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:12.199851 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9ee327a8-89c3-4f48-9268-669d28bff412 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:12.200284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9ee327a8-89c3-4f48-9268-669d28bff412 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:12.200966 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9ee327a8-89c3-4f48-9268-669d28bff412 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:12.201413 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9ee327a8-89c3-4f48-9268-669d28bff412 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:12.201828 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9ee327a8-89c3-4f48-9268-669d28bff412 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:12.215981 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-9ee327a8-89c3-4f48-9268-669d28bff412 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] HTTP exception thrown: Instance b0d11b9d-5ddc-4747-9632-d652e6c93b7b could not be found. Oct 24 13:19:12.217536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9ee327a8-89c3-4f48-9268-669d28bff412 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Request method failure captured: Oct 24 13:19:12.217536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: DELETE /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b HTTP/1.1 Oct 24 13:19:12.217536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:19:12.217536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:19:12.217536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:19:12.217536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:19:12.217536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:19:12.217536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:19:12.217536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:19:12.217536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:19:12.217536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo9AXwMG0aRbejat92eCxhMJFSv0y7_lNyhuCUN6zXnDHpFGdG48-ggi2-Do-PEfXVv_XARCMCP2kZbyq19slbwuuFeg54REDqUjfIH_fbN8NXKvJLHQXv8L_GOaWATBtTB6QuD_0kWnm_UJtW2Xnio6IxEqQIshhCCIfC1pGYUCOsE Oct 24 13:19:12.217536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:19:12.217536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:19:12.217536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:19:12.217536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:19:12.217536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:19:12.217536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:19:12.217536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:19:12.217536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:12.217536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:19:12.217536 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:19:12.219136 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:19:12.219136 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:12.219136 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:19:12.219136 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:12.219136 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:19:12.219136 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:19:12.219136 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:19:12.219136 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: c5619c8183e04e1d9073f1b40e057967 Oct 24 13:19:12.219136 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:19:12.219136 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:19:12.219136 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Instance b0d11b9d-5ddc-4747-9632-d652e6c93b7b could not be found. Oct 24 13:19:12.219136 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': 'b0d11b9d-5ddc-4747-9632-d652e6c93b7b'} Oct 24 13:19:12.220034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:12.220034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:12.220034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:19:12.220034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:19:12.220034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:19:12.220034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:19:12.220034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:19:12.220034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:19:12.220034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:19:12.220034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:19:12.220034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0d11b9d-5ddc-4747-9632-d652e6c93b7b could not be found. Oct 24 13:19:12.220034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:12.220034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:12.220034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:12.220034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:12.220034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:12.220034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:12.220034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:12.220034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:12.220034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:12.221458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:12.221458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:19:12.221458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:19:12.221458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:19:12.221458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:19:12.221458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:19:12.221458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:19:12.221458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:19:12.221458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:12.221458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0d11b9d-5ddc-4747-9632-d652e6c93b7b could not be found. Oct 24 13:19:12.221458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:12.221458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:12.221458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:12.221458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:12.221458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:12.221458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:12.221458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:12.221458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:12.221458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0d11b9d-5ddc-4747-9632-d652e6c93b7b could not be found. Oct 24 13:19:12.221458 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:12.223617 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9ee327a8-89c3-4f48-9268-669d28bff412 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Returning 404 to user: Instance b0d11b9d-5ddc-4747-9632-d652e6c93b7b could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:12.223617 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-9ee327a8-89c3-4f48-9268-669d28bff412 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b" status: 404 len: 111 microversion: 2.1 time: 0.032084 Oct 24 13:19:12.223617 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 422/869] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:19:12 2022] DELETE /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:19:12.228433 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-02ad53fb-239e-47a1-9db9-8315378254f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:12.234264 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-02ad53fb-239e-47a1-9db9-8315378254f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] [instance: b0d11b9d-5ddc-4747-9632-d652e6c93b7b] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:12.235794 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02ad53fb-239e-47a1-9db9-8315378254f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:12.236381 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02ad53fb-239e-47a1-9db9-8315378254f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:12.236886 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02ad53fb-239e-47a1-9db9-8315378254f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:12.237649 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02ad53fb-239e-47a1-9db9-8315378254f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:12.238695 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02ad53fb-239e-47a1-9db9-8315378254f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:12.239513 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-02ad53fb-239e-47a1-9db9-8315378254f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:12.253183 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-02ad53fb-239e-47a1-9db9-8315378254f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] HTTP exception thrown: Instance b0d11b9d-5ddc-4747-9632-d652e6c93b7b could not be found. Oct 24 13:19:12.255503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-02ad53fb-239e-47a1-9db9-8315378254f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Request method failure captured: Oct 24 13:19:12.255503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b HTTP/1.1 Oct 24 13:19:12.255503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:19:12.255503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:19:12.255503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:19:12.255503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:19:12.255503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:19:12.255503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:19:12.255503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:19:12.255503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:19:12.255503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVo9AXwMG0aRbejat92eCxhMJFSv0y7_lNyhuCUN6zXnDHpFGdG48-ggi2-Do-PEfXVv_XARCMCP2kZbyq19slbwuuFeg54REDqUjfIH_fbN8NXKvJLHQXv8L_GOaWATBtTB6QuD_0kWnm_UJtW2Xnio6IxEqQIshhCCIfC1pGYUCOsE Oct 24 13:19:12.255503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:19:12.255503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:19:12.255503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:19:12.255503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:19:12.255503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:19:12.255503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:19:12.255503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:19:12.255503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:12.255503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:19:12.255503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:19:12.257068 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_69beb82dd21b447d8a784e0570c4323c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:19:12.257068 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:12.257068 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: 69beb82dd21b447d8a784e0570c4323c Oct 24 13:19:12.257068 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-821574564 Oct 24 13:19:12.257068 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:19:12.257068 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:19:12.257068 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:19:12.257068 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: c5619c8183e04e1d9073f1b40e057967 Oct 24 13:19:12.257068 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-AttachVolumeNegativeTest-821574564-project Oct 24 13:19:12.257068 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:19:12.257068 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Instance b0d11b9d-5ddc-4747-9632-d652e6c93b7b could not be found. Oct 24 13:19:12.257068 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': 'b0d11b9d-5ddc-4747-9632-d652e6c93b7b'} Oct 24 13:19:12.257945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:12.257945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:12.257945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:19:12.257945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:19:12.257945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:19:12.257945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:19:12.257945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:19:12.257945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:19:12.257945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:19:12.257945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:19:12.257945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0d11b9d-5ddc-4747-9632-d652e6c93b7b could not be found. Oct 24 13:19:12.257945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:12.257945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:12.257945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:12.257945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:12.257945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:12.257945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:12.257945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:12.257945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:12.257945 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:12.259219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:12.259219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:19:12.259219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:19:12.259219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:19:12.259219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:19:12.259219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:19:12.259219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:12.259219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0d11b9d-5ddc-4747-9632-d652e6c93b7b could not be found. Oct 24 13:19:12.259219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:12.259219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:12.259219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:12.259219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:12.259219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:12.259219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:12.259219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:12.259219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:12.259219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0d11b9d-5ddc-4747-9632-d652e6c93b7b could not be found. Oct 24 13:19:12.259219 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:12.260333 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-02ad53fb-239e-47a1-9db9-8315378254f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] Returning 404 to user: Instance b0d11b9d-5ddc-4747-9632-d652e6c93b7b could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:12.260333 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-02ad53fb-239e-47a1-9db9-8315378254f2 tempest-AttachVolumeNegativeTest-821574564 tempest-AttachVolumeNegativeTest-821574564-project] 10.222.0.42 "GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b" status: 404 len: 111 microversion: 2.1 time: 0.032560 Oct 24 13:19:12.260333 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 448/870] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:12 2022] GET /compute/v2.1/servers/b0d11b9d-5ddc-4747-9632-d652e6c93b7b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:19:13.134238 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-ba67350b-e459-42fd-90d3-f9c5781ad1e8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:13.136771 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-ba67350b-e459-42fd-90d3-f9c5781ad1e8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:13.142636 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ba67350b-e459-42fd-90d3-f9c5781ad1e8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:13.143149 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ba67350b-e459-42fd-90d3-f9c5781ad1e8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:13.143592 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ba67350b-e459-42fd-90d3-f9c5781ad1e8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:13.144857 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ba67350b-e459-42fd-90d3-f9c5781ad1e8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:13.145352 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ba67350b-e459-42fd-90d3-f9c5781ad1e8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:13.145842 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ba67350b-e459-42fd-90d3-f9c5781ad1e8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:13.175871 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-ba67350b-e459-42fd-90d3-f9c5781ad1e8 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045269 Oct 24 13:19:13.176437 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 423/871] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:19:13 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:13.187421 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-8e82b797-7875-4520-bbcf-3af44da841fa tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:13.188044 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-8e82b797-7875-4520-bbcf-3af44da841fa tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:13.195240 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8e82b797-7875-4520-bbcf-3af44da841fa tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:13.195730 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8e82b797-7875-4520-bbcf-3af44da841fa tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:13.196168 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8e82b797-7875-4520-bbcf-3af44da841fa tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:13.196872 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8e82b797-7875-4520-bbcf-3af44da841fa tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:13.197329 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8e82b797-7875-4520-bbcf-3af44da841fa tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:13.197751 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8e82b797-7875-4520-bbcf-3af44da841fa tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:13.233877 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-8e82b797-7875-4520-bbcf-3af44da841fa tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-volume_attachments/9384d8fa-40a6-42ee-8706-e285ea339490" status: 200 len: 194 microversion: 2.1 time: 0.050282 Oct 24 13:19:13.235130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 449/872] 10.222.0.42 () {58 vars in 1413 bytes} [Mon Oct 24 13:19:13 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-volume_attachments/9384d8fa-40a6-42ee-8706-e285ea339490 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:14.655372 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-295a8d60-fdda-402b-aca1-41191bbb381f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb678b2f-0284-48b0-9ca4-0a03cf259f90"}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:19:14.658974 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-295a8d60-fdda-402b-aca1-41191bbb381f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:14.666511 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-295a8d60-fdda-402b-aca1-41191bbb381f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:14.667112 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-295a8d60-fdda-402b-aca1-41191bbb381f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:14.667632 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-295a8d60-fdda-402b-aca1-41191bbb381f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:14.668412 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-295a8d60-fdda-402b-aca1-41191bbb381f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:14.669101 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-295a8d60-fdda-402b-aca1-41191bbb381f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:14.669960 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-295a8d60-fdda-402b-aca1-41191bbb381f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:15.009283 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-295a8d60-fdda-402b-aca1-41191bbb381f tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "POST /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.358899 Oct 24 13:19:15.010036 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 424/873] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Oct 24 13:19:14 2022] POST /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-volume_attachments => generated 194 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:22.793456 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d05b6309-0547-4293-9630-17aaf65a28e7 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:22.795698 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-d05b6309-0547-4293-9630-17aaf65a28e7 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:22.805437 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d05b6309-0547-4293-9630-17aaf65a28e7 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:22.806875 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d05b6309-0547-4293-9630-17aaf65a28e7 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:22.807720 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d05b6309-0547-4293-9630-17aaf65a28e7 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:22.809938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d05b6309-0547-4293-9630-17aaf65a28e7 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:22.811115 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d05b6309-0547-4293-9630-17aaf65a28e7 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:22.812430 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d05b6309-0547-4293-9630-17aaf65a28e7 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:22.851514 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-d05b6309-0547-4293-9630-17aaf65a28e7 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.061841 Oct 24 13:19:22.852075 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 450/874] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:19:22 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-volume_attachments => generated 371 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:22.990350 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-6c48c5fa-5f30-4db0-b10a-95121a20474b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:22.991177 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-6c48c5fa-5f30-4db0-b10a-95121a20474b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:23.002310 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6c48c5fa-5f30-4db0-b10a-95121a20474b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:23.004319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6c48c5fa-5f30-4db0-b10a-95121a20474b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:23.004956 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6c48c5fa-5f30-4db0-b10a-95121a20474b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:23.006070 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6c48c5fa-5f30-4db0-b10a-95121a20474b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:23.007218 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6c48c5fa-5f30-4db0-b10a-95121a20474b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:23.007626 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6c48c5fa-5f30-4db0-b10a-95121a20474b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:23.041207 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-6c48c5fa-5f30-4db0-b10a-95121a20474b tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-volume_attachments/9384d8fa-40a6-42ee-8706-e285ea339490" status: 200 len: 194 microversion: 2.1 time: 0.055172 Oct 24 13:19:23.042111 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 425/875] 10.222.0.42 () {58 vars in 1413 bytes} [Mon Oct 24 13:19:22 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-volume_attachments/9384d8fa-40a6-42ee-8706-e285ea339490 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:23.052911 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a7f1d79e-4e88-48df-988a-eca7cb43c5fb tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:23.053550 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a7f1d79e-4e88-48df-988a-eca7cb43c5fb tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:23.059779 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a7f1d79e-4e88-48df-988a-eca7cb43c5fb tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:23.060499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a7f1d79e-4e88-48df-988a-eca7cb43c5fb tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:23.060932 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a7f1d79e-4e88-48df-988a-eca7cb43c5fb tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:23.061805 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a7f1d79e-4e88-48df-988a-eca7cb43c5fb tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:23.062436 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a7f1d79e-4e88-48df-988a-eca7cb43c5fb tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:23.062862 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a7f1d79e-4e88-48df-988a-eca7cb43c5fb tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:23.169719 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.objects.instance [None req-a7f1d79e-4e88-48df-988a-eca7cb43c5fb tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lazy-loading 'services' on Instance uuid 4a61a38e-37d5-4a07-8990-10906e3122dc {{(pid=118914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:19:23.270177 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a7f1d79e-4e88-48df-988a-eca7cb43c5fb tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-volume_attachments/9384d8fa-40a6-42ee-8706-e285ea339490" status: 202 len: 0 microversion: 2.1 time: 0.221310 Oct 24 13:19:23.271594 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 451/876] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 24 13:19:23 2022] DELETE /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-volume_attachments/9384d8fa-40a6-42ee-8706-e285ea339490 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:19:24.431270 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-6f838e26-cf0c-4559-9a0e-6efc18833019 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:24.432332 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-6f838e26-cf0c-4559-9a0e-6efc18833019 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:24.444449 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6f838e26-cf0c-4559-9a0e-6efc18833019 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:24.445843 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6f838e26-cf0c-4559-9a0e-6efc18833019 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:24.446170 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6f838e26-cf0c-4559-9a0e-6efc18833019 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:24.448024 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6f838e26-cf0c-4559-9a0e-6efc18833019 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:24.448984 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6f838e26-cf0c-4559-9a0e-6efc18833019 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:24.449658 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6f838e26-cf0c-4559-9a0e-6efc18833019 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:24.482802 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-6f838e26-cf0c-4559-9a0e-6efc18833019 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-volume_attachments/cb678b2f-0284-48b0-9ca4-0a03cf259f90" status: 200 len: 194 microversion: 2.1 time: 0.055929 Oct 24 13:19:24.483776 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 426/877] 10.222.0.42 () {58 vars in 1413 bytes} [Mon Oct 24 13:19:24 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-volume_attachments/cb678b2f-0284-48b0-9ca4-0a03cf259f90 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:24.495756 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-43afe8bf-d7d9-42d3-b631-bf004f1fd0a9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:24.496342 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-43afe8bf-d7d9-42d3-b631-bf004f1fd0a9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:24.514972 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-43afe8bf-d7d9-42d3-b631-bf004f1fd0a9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:24.516613 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-43afe8bf-d7d9-42d3-b631-bf004f1fd0a9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:24.517336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-43afe8bf-d7d9-42d3-b631-bf004f1fd0a9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:24.519956 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-43afe8bf-d7d9-42d3-b631-bf004f1fd0a9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:24.520962 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-43afe8bf-d7d9-42d3-b631-bf004f1fd0a9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:24.521695 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-43afe8bf-d7d9-42d3-b631-bf004f1fd0a9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:24.646187 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.objects.instance [None req-43afe8bf-d7d9-42d3-b631-bf004f1fd0a9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lazy-loading 'services' on Instance uuid 4a61a38e-37d5-4a07-8990-10906e3122dc {{(pid=118914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:19:24.744491 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-43afe8bf-d7d9-42d3-b631-bf004f1fd0a9 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-volume_attachments/cb678b2f-0284-48b0-9ca4-0a03cf259f90" status: 202 len: 0 microversion: 2.1 time: 0.252958 Oct 24 13:19:24.745718 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 452/878] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Oct 24 13:19:24 2022] DELETE /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-volume_attachments/cb678b2f-0284-48b0-9ca4-0a03cf259f90 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:19:26.034643 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-211c02d2-7daf-4a76-9a0d-56212eb1c4c4 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:26.050329 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-211c02d2-7daf-4a76-9a0d-56212eb1c4c4 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:26.071006 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-211c02d2-7daf-4a76-9a0d-56212eb1c4c4 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:26.073241 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-211c02d2-7daf-4a76-9a0d-56212eb1c4c4 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:26.073862 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-211c02d2-7daf-4a76-9a0d-56212eb1c4c4 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:26.075013 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-211c02d2-7daf-4a76-9a0d-56212eb1c4c4 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:26.078990 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-211c02d2-7daf-4a76-9a0d-56212eb1c4c4 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:26.091818 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-211c02d2-7daf-4a76-9a0d-56212eb1c4c4 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:26.162030 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:26.199961 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-211c02d2-7daf-4a76-9a0d-56212eb1c4c4 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.169245 Oct 24 13:19:26.213333 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 427/879] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:19:26 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-volume_attachments => generated 25 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:19:26.457012 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-2a8188fc-b567-49db-8882-ea3f9b005830 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:26.460210 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-2a8188fc-b567-49db-8882-ea3f9b005830 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:26.476936 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2a8188fc-b567-49db-8882-ea3f9b005830 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:26.478914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2a8188fc-b567-49db-8882-ea3f9b005830 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:26.480684 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2a8188fc-b567-49db-8882-ea3f9b005830 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:26.481803 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2a8188fc-b567-49db-8882-ea3f9b005830 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:26.487426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2a8188fc-b567-49db-8882-ea3f9b005830 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:26.489010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-2a8188fc-b567-49db-8882-ea3f9b005830 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:26.574657 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-2a8188fc-b567-49db-8882-ea3f9b005830 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.123452 Oct 24 13:19:26.583363 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 453/880] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Oct 24 13:19:26 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc/os-volume_attachments => generated 25 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 24 13:19:26.699437 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9441da7c-1e40-434e-85a4-96745148dc8c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:26.700297 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9441da7c-1e40-434e-85a4-96745148dc8c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:26.707690 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9441da7c-1e40-434e-85a4-96745148dc8c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:26.708415 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9441da7c-1e40-434e-85a4-96745148dc8c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:26.709091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9441da7c-1e40-434e-85a4-96745148dc8c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:26.710479 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9441da7c-1e40-434e-85a4-96745148dc8c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:26.711256 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9441da7c-1e40-434e-85a4-96745148dc8c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:26.711886 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9441da7c-1e40-434e-85a4-96745148dc8c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:26.745809 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9441da7c-1e40-434e-85a4-96745148dc8c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Going to try to terminate instance {{(pid=118915) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:19:26.885150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-9441da7c-1e40-434e-85a4-96745148dc8c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc" status: 204 len: 0 microversion: 2.1 time: 0.189901 Oct 24 13:19:26.886011 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 428/881] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:19:26 2022] DELETE /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:19:26.894658 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-4d16b6c7-eb1c-4e37-8824-158788888271 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:26.895592 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-4d16b6c7-eb1c-4e37-8824-158788888271 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:26.903969 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4d16b6c7-eb1c-4e37-8824-158788888271 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:26.907213 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4d16b6c7-eb1c-4e37-8824-158788888271 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:26.908451 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4d16b6c7-eb1c-4e37-8824-158788888271 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:26.911332 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4d16b6c7-eb1c-4e37-8824-158788888271 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:26.911970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4d16b6c7-eb1c-4e37-8824-158788888271 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:26.912578 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4d16b6c7-eb1c-4e37-8824-158788888271 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:27.172082 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-4d16b6c7-eb1c-4e37-8824-158788888271 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:27.184836 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-4d16b6c7-eb1c-4e37-8824-158788888271 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc" status: 200 len: 1674 microversion: 2.1 time: 0.294558 Oct 24 13:19:27.186168 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 454/882] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:26 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc => generated 1674 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:19:28.210365 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-110befe4-34cb-4ec7-a720-4062df3d1441 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:28.211563 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-110befe4-34cb-4ec7-a720-4062df3d1441 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:28.229404 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-110befe4-34cb-4ec7-a720-4062df3d1441 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:28.229819 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-110befe4-34cb-4ec7-a720-4062df3d1441 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:28.230255 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-110befe4-34cb-4ec7-a720-4062df3d1441 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:28.234963 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-110befe4-34cb-4ec7-a720-4062df3d1441 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:28.235555 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-110befe4-34cb-4ec7-a720-4062df3d1441 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:28.235994 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-110befe4-34cb-4ec7-a720-4062df3d1441 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:28.514698 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-110befe4-34cb-4ec7-a720-4062df3d1441 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:28.526248 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-110befe4-34cb-4ec7-a720-4062df3d1441 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc" status: 200 len: 1674 microversion: 2.1 time: 0.321138 Oct 24 13:19:28.533384 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 429/883] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:28 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc => generated 1674 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:19:28.986963 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-fe138487-c853-4285-8f35-a8453c4a4340 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Action: 'create', calling method: .version_select at 0x7fad2859a1f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1444731753", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMn17oAWl3DVjpNC3iwV3TICCFNv1IdMg0SAPGZhIxQjjOI7lznuYR7Vdn9n1vHQhHLjs1Ly4P/EGLjvqVSzbtNaGxvSi1fpfhEt3wsSEv91+E+ouqIdo+cANVNHXSsIhQ=="}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:19:28.994686 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:29.012927 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-fe138487-c853-4285-8f35-a8453c4a4340 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Getting quotas for project f0bee9967bdb41eca0acff51d5e105e9. Resources: {'key_pairs'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:19:29.019998 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-fe138487-c853-4285-8f35-a8453c4a4340 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Getting quotas for user af98e8f344914ae59852d82d176b4dc2 and project f0bee9967bdb41eca0acff51d5e105e9. Resources: {'key_pairs'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:19:29.051875 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-fe138487-c853-4285-8f35-a8453c4a4340 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.362120 Oct 24 13:19:29.052784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 455/884] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Oct 24 13:19:28 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:29.556832 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-5b0a791a-ce9c-409e-89ca-ba3b90f2c3fb tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:29.557444 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-5b0a791a-ce9c-409e-89ca-ba3b90f2c3fb tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:29.563918 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5b0a791a-ce9c-409e-89ca-ba3b90f2c3fb tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:29.564597 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5b0a791a-ce9c-409e-89ca-ba3b90f2c3fb tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:29.565030 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5b0a791a-ce9c-409e-89ca-ba3b90f2c3fb tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:29.566273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5b0a791a-ce9c-409e-89ca-ba3b90f2c3fb tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:29.566739 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5b0a791a-ce9c-409e-89ca-ba3b90f2c3fb tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:29.567162 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5b0a791a-ce9c-409e-89ca-ba3b90f2c3fb tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:29.679620 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-5b0a791a-ce9c-409e-89ca-ba3b90f2c3fb tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f69df43e6ca4663a9ef819c0331c13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df0bdf3ab29d43e0bf749b9814813e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:29.687301 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-5b0a791a-ce9c-409e-89ca-ba3b90f2c3fb tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc" status: 200 len: 1606 microversion: 2.1 time: 0.135098 Oct 24 13:19:29.687867 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 430/885] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:29 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc => generated 1606 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:19:29.782594 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-317ba4d0-c5ae-4560-a0a2-083e7ae88630 req-1c92668a-1a0c-4bc8-8fcc-8831fe200c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a61a38e-37d5-4a07-8990-10906e3122dc", "name": "network-vif-deleted", "tag": "b2e03576-01e9-4c65-aae0-ffd1580274d1"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:19:29.809358 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-317ba4d0-c5ae-4560-a0a2-083e7ae88630 req-1c92668a-1a0c-4bc8-8fcc-8831fe200c30 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:29.813125 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-317ba4d0-c5ae-4560-a0a2-083e7ae88630 req-1c92668a-1a0c-4bc8-8fcc-8831fe200c30 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:29.815195 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-317ba4d0-c5ae-4560-a0a2-083e7ae88630 req-1c92668a-1a0c-4bc8-8fcc-8831fe200c30 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:29.842976 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-317ba4d0-c5ae-4560-a0a2-083e7ae88630 req-1c92668a-1a0c-4bc8-8fcc-8831fe200c30 service nova] Creating event network-vif-deleted:b2e03576-01e9-4c65-aae0-ffd1580274d1 for instance 4a61a38e-37d5-4a07-8990-10906e3122dc on hv-cinder-86248 Oct 24 13:19:29.860911 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-317ba4d0-c5ae-4560-a0a2-083e7ae88630 req-1c92668a-1a0c-4bc8-8fcc-8831fe200c30 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081471 Oct 24 13:19:29.863180 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 456/886] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:30.710963 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-801f9bab-949f-4c6f-bef1-ccba1a85ca5c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:30.712389 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-801f9bab-949f-4c6f-bef1-ccba1a85ca5c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:30.719228 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-801f9bab-949f-4c6f-bef1-ccba1a85ca5c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:30.720031 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-801f9bab-949f-4c6f-bef1-ccba1a85ca5c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:30.720953 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-801f9bab-949f-4c6f-bef1-ccba1a85ca5c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:30.722171 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-801f9bab-949f-4c6f-bef1-ccba1a85ca5c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:30.722993 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-801f9bab-949f-4c6f-bef1-ccba1a85ca5c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:30.724315 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-801f9bab-949f-4c6f-bef1-ccba1a85ca5c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:30.740546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-801f9bab-949f-4c6f-bef1-ccba1a85ca5c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] HTTP exception thrown: Instance 4a61a38e-37d5-4a07-8990-10906e3122dc could not be found. Oct 24 13:19:30.742898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-801f9bab-949f-4c6f-bef1-ccba1a85ca5c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Request method failure captured: Oct 24 13:19:30.742898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc HTTP/1.1 Oct 24 13:19:30.742898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:19:30.742898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:19:30.742898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:19:30.742898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:19:30.742898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:19:30.742898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:19:30.742898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:19:30.742898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:19:30.742898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo-GeR-HXjzW-cLwol3MKpeZg9RjVRbhk6vm97zhGoa7ad-OV1f3Sk_SoBtQ5944X1NmnRtyI5SC1EsKICVzBJZdAynivxtGpKIUY7eq_X7YV1Xp1STj1hqtApKA5WO_jW0Zdojq4uejhJH9CiEfd_kndYYa1eA1IWj7f23R3KHx08I Oct 24 13:19:30.742898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:19:30.742898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:19:30.742898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:19:30.742898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:19:30.742898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:19:30.742898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:19:30.742898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: df0bdf3ab29d43e0bf749b9814813e5c Oct 24 13:19:30.742898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-AttachVolumeTestJSON-1191960355 Oct 24 13:19:30.742898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:19:30.742898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:19:30.744575 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:19:30.744575 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-AttachVolumeTestJSON-1191960355 Oct 24 13:19:30.744575 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: df0bdf3ab29d43e0bf749b9814813e5c Oct 24 13:19:30.744575 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1191960355 Oct 24 13:19:30.744575 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-AttachVolumeTestJSON-1191960355-project Oct 24 13:19:30.744575 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:19:30.744575 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:19:30.744575 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: 3f69df43e6ca4663a9ef819c0331c13d Oct 24 13:19:30.744575 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-AttachVolumeTestJSON-1191960355-project Oct 24 13:19:30.744575 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:19:30.744575 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Instance 4a61a38e-37d5-4a07-8990-10906e3122dc could not be found. Oct 24 13:19:30.744575 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': '4a61a38e-37d5-4a07-8990-10906e3122dc'} Oct 24 13:19:30.745506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:30.745506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:30.745506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:19:30.745506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:19:30.745506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:19:30.745506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:19:30.745506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:19:30.745506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:19:30.745506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:19:30.745506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:19:30.745506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a61a38e-37d5-4a07-8990-10906e3122dc could not be found. Oct 24 13:19:30.745506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:30.745506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:30.745506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:30.745506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:30.745506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:30.745506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:30.745506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:30.745506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:30.745506 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:30.746992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:30.746992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:19:30.746992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:19:30.746992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:19:30.746992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:19:30.746992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:19:30.746992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:30.746992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a61a38e-37d5-4a07-8990-10906e3122dc could not be found. Oct 24 13:19:30.746992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:30.746992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:30.746992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:30.746992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:30.746992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:30.746992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:30.746992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:30.746992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:30.746992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a61a38e-37d5-4a07-8990-10906e3122dc could not be found. Oct 24 13:19:30.746992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:30.749333 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-801f9bab-949f-4c6f-bef1-ccba1a85ca5c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Returning 404 to user: Instance 4a61a38e-37d5-4a07-8990-10906e3122dc could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:30.750498 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-801f9bab-949f-4c6f-bef1-ccba1a85ca5c tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc" status: 404 len: 111 microversion: 2.1 time: 0.043567 Oct 24 13:19:30.751269 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 431/887] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:30 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:19:30.763370 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-7b1b43ee-760a-45cc-a51d-771d17974ddf tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '.version_select at 0x7fad283fd1f0>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:30.791283 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-7b1b43ee-760a-45cc-a51d-771d17974ddf tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298102662" status: 202 len: 0 microversion: 2.1 time: 0.033488 Oct 24 13:19:30.792183 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 457/888] 10.222.0.42 () {58 vars in 1221 bytes} [Mon Oct 24 13:19:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298102662 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:19:34.125090 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-7f36fad0-6719-4dc9-b32d-b8ecd9a59759 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:34.125818 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-7f36fad0-6719-4dc9-b32d-b8ecd9a59759 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:34.133214 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7f36fad0-6719-4dc9-b32d-b8ecd9a59759 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:34.133814 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7f36fad0-6719-4dc9-b32d-b8ecd9a59759 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:34.134248 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7f36fad0-6719-4dc9-b32d-b8ecd9a59759 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:34.134944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7f36fad0-6719-4dc9-b32d-b8ecd9a59759 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:34.135452 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7f36fad0-6719-4dc9-b32d-b8ecd9a59759 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:34.136288 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7f36fad0-6719-4dc9-b32d-b8ecd9a59759 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:34.151322 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-7f36fad0-6719-4dc9-b32d-b8ecd9a59759 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] HTTP exception thrown: Instance 4a61a38e-37d5-4a07-8990-10906e3122dc could not be found. Oct 24 13:19:34.153341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-7f36fad0-6719-4dc9-b32d-b8ecd9a59759 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Request method failure captured: Oct 24 13:19:34.153341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: DELETE /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc HTTP/1.1 Oct 24 13:19:34.153341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:19:34.153341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:19:34.153341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:19:34.153341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:19:34.153341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:19:34.153341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:19:34.153341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:19:34.153341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:19:34.153341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo-GeR-HXjzW-cLwol3MKpeZg9RjVRbhk6vm97zhGoa7ad-OV1f3Sk_SoBtQ5944X1NmnRtyI5SC1EsKICVzBJZdAynivxtGpKIUY7eq_X7YV1Xp1STj1hqtApKA5WO_jW0Zdojq4uejhJH9CiEfd_kndYYa1eA1IWj7f23R3KHx08I Oct 24 13:19:34.153341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:19:34.153341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:19:34.153341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:19:34.153341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:19:34.153341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:19:34.153341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:19:34.153341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: df0bdf3ab29d43e0bf749b9814813e5c Oct 24 13:19:34.153341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-AttachVolumeTestJSON-1191960355 Oct 24 13:19:34.153341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:19:34.153341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:19:34.155395 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:19:34.155395 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-AttachVolumeTestJSON-1191960355 Oct 24 13:19:34.155395 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: df0bdf3ab29d43e0bf749b9814813e5c Oct 24 13:19:34.155395 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1191960355 Oct 24 13:19:34.155395 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-AttachVolumeTestJSON-1191960355-project Oct 24 13:19:34.155395 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:19:34.155395 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:19:34.155395 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: 3f69df43e6ca4663a9ef819c0331c13d Oct 24 13:19:34.155395 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-AttachVolumeTestJSON-1191960355-project Oct 24 13:19:34.155395 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:19:34.155395 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Instance 4a61a38e-37d5-4a07-8990-10906e3122dc could not be found. Oct 24 13:19:34.155395 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': '4a61a38e-37d5-4a07-8990-10906e3122dc'} Oct 24 13:19:34.156184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:34.156184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:34.156184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:19:34.156184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:19:34.156184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:19:34.156184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:19:34.156184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:19:34.156184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:19:34.156184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:19:34.156184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:19:34.156184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a61a38e-37d5-4a07-8990-10906e3122dc could not be found. Oct 24 13:19:34.156184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:34.156184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:34.156184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:34.156184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:34.156184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:34.156184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:34.156184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:34.156184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:34.156184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:34.157894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:34.157894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:19:34.157894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:19:34.157894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:19:34.157894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:19:34.157894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:19:34.157894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:19:34.157894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:19:34.157894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:34.157894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a61a38e-37d5-4a07-8990-10906e3122dc could not be found. Oct 24 13:19:34.157894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:34.157894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:34.157894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:34.157894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:34.157894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:34.157894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:34.157894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:34.157894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:34.157894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a61a38e-37d5-4a07-8990-10906e3122dc could not be found. Oct 24 13:19:34.157894 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:34.159343 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-7f36fad0-6719-4dc9-b32d-b8ecd9a59759 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Returning 404 to user: Instance 4a61a38e-37d5-4a07-8990-10906e3122dc could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:34.159343 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-7f36fad0-6719-4dc9-b32d-b8ecd9a59759 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc" status: 404 len: 111 microversion: 2.1 time: 0.035850 Oct 24 13:19:34.159343 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 432/889] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:19:34 2022] DELETE /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:19:34.166404 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-1fb37321-fde6-429b-a01a-f6c33e4c4099 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:34.167176 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-1fb37321-fde6-429b-a01a-f6c33e4c4099 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 4a61a38e-37d5-4a07-8990-10906e3122dc] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:34.173801 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1fb37321-fde6-429b-a01a-f6c33e4c4099 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:34.174291 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1fb37321-fde6-429b-a01a-f6c33e4c4099 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:34.174865 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1fb37321-fde6-429b-a01a-f6c33e4c4099 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:34.175669 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1fb37321-fde6-429b-a01a-f6c33e4c4099 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:34.176124 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1fb37321-fde6-429b-a01a-f6c33e4c4099 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:34.176554 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1fb37321-fde6-429b-a01a-f6c33e4c4099 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:34.189656 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-1fb37321-fde6-429b-a01a-f6c33e4c4099 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] HTTP exception thrown: Instance 4a61a38e-37d5-4a07-8990-10906e3122dc could not be found. Oct 24 13:19:34.191892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-1fb37321-fde6-429b-a01a-f6c33e4c4099 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Request method failure captured: Oct 24 13:19:34.191892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc HTTP/1.1 Oct 24 13:19:34.191892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:19:34.191892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:19:34.191892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:19:34.191892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:19:34.191892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:19:34.191892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:19:34.191892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:19:34.191892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:19:34.191892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVo-GeR-HXjzW-cLwol3MKpeZg9RjVRbhk6vm97zhGoa7ad-OV1f3Sk_SoBtQ5944X1NmnRtyI5SC1EsKICVzBJZdAynivxtGpKIUY7eq_X7YV1Xp1STj1hqtApKA5WO_jW0Zdojq4uejhJH9CiEfd_kndYYa1eA1IWj7f23R3KHx08I Oct 24 13:19:34.191892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:19:34.191892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:19:34.191892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:19:34.191892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:19:34.191892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:19:34.191892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:19:34.191892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: df0bdf3ab29d43e0bf749b9814813e5c Oct 24 13:19:34.191892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-AttachVolumeTestJSON-1191960355 Oct 24 13:19:34.191892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:19:34.191892 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:19:34.193500 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:19:34.193500 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-AttachVolumeTestJSON-1191960355 Oct 24 13:19:34.193500 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: df0bdf3ab29d43e0bf749b9814813e5c Oct 24 13:19:34.193500 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1191960355 Oct 24 13:19:34.193500 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-AttachVolumeTestJSON-1191960355-project Oct 24 13:19:34.193500 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:19:34.193500 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:19:34.193500 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: 3f69df43e6ca4663a9ef819c0331c13d Oct 24 13:19:34.193500 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-AttachVolumeTestJSON-1191960355-project Oct 24 13:19:34.193500 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:19:34.193500 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Instance 4a61a38e-37d5-4a07-8990-10906e3122dc could not be found. Oct 24 13:19:34.193500 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': '4a61a38e-37d5-4a07-8990-10906e3122dc'} Oct 24 13:19:34.194506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:34.194506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:34.194506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:19:34.194506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:19:34.194506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:19:34.194506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:19:34.194506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:19:34.194506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:19:34.194506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:19:34.194506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:19:34.194506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a61a38e-37d5-4a07-8990-10906e3122dc could not be found. Oct 24 13:19:34.194506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:34.194506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:34.194506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:34.194506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:34.194506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:34.194506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:34.194506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:34.194506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:34.194506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:34.196059 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:34.196059 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:19:34.196059 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:19:34.196059 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:19:34.196059 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:19:34.196059 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:19:34.196059 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:34.196059 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a61a38e-37d5-4a07-8990-10906e3122dc could not be found. Oct 24 13:19:34.196059 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:34.196059 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:34.196059 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:34.196059 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:34.196059 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:34.196059 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:34.196059 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:34.196059 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:34.196059 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a61a38e-37d5-4a07-8990-10906e3122dc could not be found. Oct 24 13:19:34.196059 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:34.197398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-1fb37321-fde6-429b-a01a-f6c33e4c4099 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Returning 404 to user: Instance 4a61a38e-37d5-4a07-8990-10906e3122dc could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:34.197398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-1fb37321-fde6-429b-a01a-f6c33e4c4099 tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc" status: 404 len: 111 microversion: 2.1 time: 0.031320 Oct 24 13:19:34.197398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 458/890] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:34 2022] GET /compute/v2.1/servers/4a61a38e-37d5-4a07-8990-10906e3122dc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:19:35.362751 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-f39a0f7f-072d-498f-853a-1a272f5121cc tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:35.363821 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-f39a0f7f-072d-498f-853a-1a272f5121cc tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:35.371520 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f39a0f7f-072d-498f-853a-1a272f5121cc tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:35.372257 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f39a0f7f-072d-498f-853a-1a272f5121cc tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:35.372727 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f39a0f7f-072d-498f-853a-1a272f5121cc tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:35.373454 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f39a0f7f-072d-498f-853a-1a272f5121cc tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:35.373940 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f39a0f7f-072d-498f-853a-1a272f5121cc tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:35.374366 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f39a0f7f-072d-498f-853a-1a272f5121cc tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:35.391188 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-f39a0f7f-072d-498f-853a-1a272f5121cc tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] HTTP exception thrown: Instance 29f8f878-fe8d-4dd0-9478-268c08885faf could not be found. Oct 24 13:19:35.393029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-f39a0f7f-072d-498f-853a-1a272f5121cc tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Request method failure captured: Oct 24 13:19:35.393029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: DELETE /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf HTTP/1.1 Oct 24 13:19:35.393029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:19:35.393029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:19:35.393029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:19:35.393029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:19:35.393029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:19:35.393029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:19:35.393029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:19:35.393029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:19:35.393029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo-GeR-HXjzW-cLwol3MKpeZg9RjVRbhk6vm97zhGoa7ad-OV1f3Sk_SoBtQ5944X1NmnRtyI5SC1EsKICVzBJZdAynivxtGpKIUY7eq_X7YV1Xp1STj1hqtApKA5WO_jW0Zdojq4uejhJH9CiEfd_kndYYa1eA1IWj7f23R3KHx08I Oct 24 13:19:35.393029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:19:35.393029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:19:35.393029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:19:35.393029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:19:35.393029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:19:35.393029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:19:35.393029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: df0bdf3ab29d43e0bf749b9814813e5c Oct 24 13:19:35.393029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-AttachVolumeTestJSON-1191960355 Oct 24 13:19:35.393029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:19:35.393029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:19:35.394644 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:19:35.394644 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-AttachVolumeTestJSON-1191960355 Oct 24 13:19:35.394644 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: df0bdf3ab29d43e0bf749b9814813e5c Oct 24 13:19:35.394644 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1191960355 Oct 24 13:19:35.394644 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-AttachVolumeTestJSON-1191960355-project Oct 24 13:19:35.394644 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:19:35.394644 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:19:35.394644 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: 3f69df43e6ca4663a9ef819c0331c13d Oct 24 13:19:35.394644 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-AttachVolumeTestJSON-1191960355-project Oct 24 13:19:35.394644 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:19:35.394644 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Instance 29f8f878-fe8d-4dd0-9478-268c08885faf could not be found. Oct 24 13:19:35.394644 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': '29f8f878-fe8d-4dd0-9478-268c08885faf'} Oct 24 13:19:35.395798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:35.395798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:35.395798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:19:35.395798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:19:35.395798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:19:35.395798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:19:35.395798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:19:35.395798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:19:35.395798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:19:35.395798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:19:35.395798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29f8f878-fe8d-4dd0-9478-268c08885faf could not be found. Oct 24 13:19:35.395798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:35.395798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:35.395798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:35.395798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:35.395798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:35.395798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:35.395798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:35.395798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:35.395798 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:35.397284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:35.397284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:19:35.397284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:19:35.397284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:19:35.397284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:19:35.397284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:19:35.397284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:19:35.397284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:19:35.397284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:35.397284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29f8f878-fe8d-4dd0-9478-268c08885faf could not be found. Oct 24 13:19:35.397284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:35.397284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:35.397284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:35.397284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:35.397284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:35.397284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:35.397284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:35.397284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:35.397284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29f8f878-fe8d-4dd0-9478-268c08885faf could not be found. Oct 24 13:19:35.397284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:35.398849 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-f39a0f7f-072d-498f-853a-1a272f5121cc tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Returning 404 to user: Instance 29f8f878-fe8d-4dd0-9478-268c08885faf could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:35.398849 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-f39a0f7f-072d-498f-853a-1a272f5121cc tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "DELETE /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 404 len: 111 microversion: 2.1 time: 0.036720 Oct 24 13:19:35.398849 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 433/891] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:19:35 2022] DELETE /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:19:35.403767 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-29694ab9-d913-49e9-adb5-e4b9ebd2d25e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:35.404501 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-29694ab9-d913-49e9-adb5-e4b9ebd2d25e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] [instance: 29f8f878-fe8d-4dd0-9478-268c08885faf] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:35.413393 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-29694ab9-d913-49e9-adb5-e4b9ebd2d25e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:35.413885 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-29694ab9-d913-49e9-adb5-e4b9ebd2d25e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:35.414326 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-29694ab9-d913-49e9-adb5-e4b9ebd2d25e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:35.415029 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-29694ab9-d913-49e9-adb5-e4b9ebd2d25e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:35.415551 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-29694ab9-d913-49e9-adb5-e4b9ebd2d25e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:35.415974 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-29694ab9-d913-49e9-adb5-e4b9ebd2d25e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:35.431330 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-29694ab9-d913-49e9-adb5-e4b9ebd2d25e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] HTTP exception thrown: Instance 29f8f878-fe8d-4dd0-9478-268c08885faf could not be found. Oct 24 13:19:35.432856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-29694ab9-d913-49e9-adb5-e4b9ebd2d25e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Request method failure captured: Oct 24 13:19:35.432856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf HTTP/1.1 Oct 24 13:19:35.432856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:19:35.432856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:19:35.432856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:19:35.432856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:19:35.432856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:19:35.432856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:19:35.432856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:19:35.432856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:19:35.432856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVo-GeR-HXjzW-cLwol3MKpeZg9RjVRbhk6vm97zhGoa7ad-OV1f3Sk_SoBtQ5944X1NmnRtyI5SC1EsKICVzBJZdAynivxtGpKIUY7eq_X7YV1Xp1STj1hqtApKA5WO_jW0Zdojq4uejhJH9CiEfd_kndYYa1eA1IWj7f23R3KHx08I Oct 24 13:19:35.432856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:19:35.432856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:19:35.432856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:19:35.432856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:19:35.432856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:19:35.432856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:19:35.432856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: df0bdf3ab29d43e0bf749b9814813e5c Oct 24 13:19:35.432856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-AttachVolumeTestJSON-1191960355 Oct 24 13:19:35.432856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:19:35.432856 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:19:35.434275 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_df0bdf3ab29d43e0bf749b9814813e5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:19:35.434275 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-AttachVolumeTestJSON-1191960355 Oct 24 13:19:35.434275 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: df0bdf3ab29d43e0bf749b9814813e5c Oct 24 13:19:35.434275 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1191960355 Oct 24 13:19:35.434275 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-AttachVolumeTestJSON-1191960355-project Oct 24 13:19:35.434275 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:19:35.434275 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:19:35.434275 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: 3f69df43e6ca4663a9ef819c0331c13d Oct 24 13:19:35.434275 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-AttachVolumeTestJSON-1191960355-project Oct 24 13:19:35.434275 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:19:35.434275 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Instance 29f8f878-fe8d-4dd0-9478-268c08885faf could not be found. Oct 24 13:19:35.434275 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': '29f8f878-fe8d-4dd0-9478-268c08885faf'} Oct 24 13:19:35.435418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:35.435418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:35.435418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:19:35.435418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:19:35.435418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:19:35.435418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:19:35.435418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:19:35.435418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:19:35.435418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:19:35.435418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:19:35.435418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29f8f878-fe8d-4dd0-9478-268c08885faf could not be found. Oct 24 13:19:35.435418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:35.435418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:35.435418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:35.435418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:35.435418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:35.435418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:35.435418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:35.435418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:35.435418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:35.436804 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:35.436804 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:19:35.436804 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:19:35.436804 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:19:35.436804 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:19:35.436804 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:19:35.436804 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:35.436804 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29f8f878-fe8d-4dd0-9478-268c08885faf could not be found. Oct 24 13:19:35.436804 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:35.436804 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:35.436804 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:35.436804 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:35.436804 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:35.436804 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:35.436804 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:35.436804 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:35.436804 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29f8f878-fe8d-4dd0-9478-268c08885faf could not be found. Oct 24 13:19:35.436804 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:35.437948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-29694ab9-d913-49e9-adb5-e4b9ebd2d25e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] Returning 404 to user: Instance 29f8f878-fe8d-4dd0-9478-268c08885faf could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:35.437948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-29694ab9-d913-49e9-adb5-e4b9ebd2d25e tempest-AttachVolumeTestJSON-1191960355 tempest-AttachVolumeTestJSON-1191960355-project] 10.222.0.42 "GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf" status: 404 len: 111 microversion: 2.1 time: 0.034841 Oct 24 13:19:35.437948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 459/892] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:35 2022] GET /compute/v2.1/servers/29f8f878-fe8d-4dd0-9478-268c08885faf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:19:36.447702 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-c2b2bad0-7e1c-48ce-933f-9ca162774c28 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:36.450499 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-c2b2bad0-7e1c-48ce-933f-9ca162774c28 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:36.461045 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:36.465576 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c2b2bad0-7e1c-48ce-933f-9ca162774c28 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:36.467269 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c2b2bad0-7e1c-48ce-933f-9ca162774c28 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:36.467712 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c2b2bad0-7e1c-48ce-933f-9ca162774c28 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:36.468658 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c2b2bad0-7e1c-48ce-933f-9ca162774c28 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:36.469293 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c2b2bad0-7e1c-48ce-933f-9ca162774c28 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:36.469718 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c2b2bad0-7e1c-48ce-933f-9ca162774c28 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:36.505591 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-c2b2bad0-7e1c-48ce-933f-9ca162774c28 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062528 Oct 24 13:19:36.506321 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 434/893] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Oct 24 13:19:36 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:19:36.600619 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-f0f10fe7-7129-432a-b8cc-3eaecdedd4a8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:36.601982 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-f0f10fe7-7129-432a-b8cc-3eaecdedd4a8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:36.609661 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f0f10fe7-7129-432a-b8cc-3eaecdedd4a8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:36.610469 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f0f10fe7-7129-432a-b8cc-3eaecdedd4a8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:36.611138 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f0f10fe7-7129-432a-b8cc-3eaecdedd4a8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:36.612235 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f0f10fe7-7129-432a-b8cc-3eaecdedd4a8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:36.613085 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f0f10fe7-7129-432a-b8cc-3eaecdedd4a8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:36.613739 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-f0f10fe7-7129-432a-b8cc-3eaecdedd4a8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:36.648096 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-f0f10fe7-7129-432a-b8cc-3eaecdedd4a8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Going to try to terminate instance {{(pid=118914) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:19:36.748209 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-f0f10fe7-7129-432a-b8cc-3eaecdedd4a8 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "DELETE /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 204 len: 0 microversion: 2.20 time: 0.151166 Oct 24 13:19:36.749143 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 460/894] 10.222.0.42 () {60 vars in 1280 bytes} [Mon Oct 24 13:19:36 2022] DELETE /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 13:19:36.759160 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-5b3e5520-3e50-499b-a5e6-33470a59a997 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:36.759774 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-5b3e5520-3e50-499b-a5e6-33470a59a997 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:36.769098 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5b3e5520-3e50-499b-a5e6-33470a59a997 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:36.769589 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5b3e5520-3e50-499b-a5e6-33470a59a997 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:36.770024 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5b3e5520-3e50-499b-a5e6-33470a59a997 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:36.770728 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5b3e5520-3e50-499b-a5e6-33470a59a997 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:36.771197 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5b3e5520-3e50-499b-a5e6-33470a59a997 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:36.771782 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5b3e5520-3e50-499b-a5e6-33470a59a997 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:37.037569 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-5b3e5520-3e50-499b-a5e6-33470a59a997 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:37.045958 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-5b3e5520-3e50-499b-a5e6-33470a59a997 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:37.047505 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-5b3e5520-3e50-499b-a5e6-33470a59a997 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:37.048687 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-5b3e5520-3e50-499b-a5e6-33470a59a997 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1723 microversion: 2.20 time: 0.294672 Oct 24 13:19:37.049246 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 435/895] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:19:36 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 24 13:19:38.084935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-46d4c1a8-16dd-48ba-81d8-2978b2cf23a4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:38.086934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-46d4c1a8-16dd-48ba-81d8-2978b2cf23a4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:38.100995 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-46d4c1a8-16dd-48ba-81d8-2978b2cf23a4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:38.101768 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-46d4c1a8-16dd-48ba-81d8-2978b2cf23a4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:38.102369 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-46d4c1a8-16dd-48ba-81d8-2978b2cf23a4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:38.103356 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-46d4c1a8-16dd-48ba-81d8-2978b2cf23a4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:38.103976 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-46d4c1a8-16dd-48ba-81d8-2978b2cf23a4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:38.104561 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-46d4c1a8-16dd-48ba-81d8-2978b2cf23a4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:38.410953 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-46d4c1a8-16dd-48ba-81d8-2978b2cf23a4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:38.427282 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-46d4c1a8-16dd-48ba-81d8-2978b2cf23a4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:38.429783 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-46d4c1a8-16dd-48ba-81d8-2978b2cf23a4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:38.432051 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-46d4c1a8-16dd-48ba-81d8-2978b2cf23a4 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1723 microversion: 2.20 time: 0.354818 Oct 24 13:19:38.436477 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 461/896] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:19:38 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1723 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:19:39.467474 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-a479b770-838b-4e6a-9db6-d046126272c9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:39.468039 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-a479b770-838b-4e6a-9db6-d046126272c9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:39.482236 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a479b770-838b-4e6a-9db6-d046126272c9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:39.482732 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a479b770-838b-4e6a-9db6-d046126272c9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:39.483193 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a479b770-838b-4e6a-9db6-d046126272c9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:39.483901 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a479b770-838b-4e6a-9db6-d046126272c9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:39.484361 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a479b770-838b-4e6a-9db6-d046126272c9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:39.484781 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a479b770-838b-4e6a-9db6-d046126272c9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:39.624446 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-a479b770-838b-4e6a-9db6-d046126272c9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:39.649308 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-a479b770-838b-4e6a-9db6-d046126272c9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:39.651934 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-a479b770-838b-4e6a-9db6-d046126272c9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3e02f6f701324af6b53762569f1a9d21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b736b09b6ee2492590cbc23db48752f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:39.653777 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-a479b770-838b-4e6a-9db6-d046126272c9 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 200 len: 1655 microversion: 2.20 time: 0.189967 Oct 24 13:19:39.654818 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 436/897] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:19:39 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 1655 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 24 13:19:39.801230 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-e3732802-9532-4e38-bec0-2cbd3025a4be req-cb496785-3c4f-4219-b726-a43badb25c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54a71380-34c3-40b5-a376-1622f1e44528", "name": "network-vif-deleted", "tag": "486a8286-8bd4-4826-a629-5c1b4c9df0e1"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:19:39.807931 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=4 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:39.818088 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-e3732802-9532-4e38-bec0-2cbd3025a4be req-cb496785-3c4f-4219-b726-a43badb25c55 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:39.824786 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-e3732802-9532-4e38-bec0-2cbd3025a4be req-cb496785-3c4f-4219-b726-a43badb25c55 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:39.825589 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-e3732802-9532-4e38-bec0-2cbd3025a4be req-cb496785-3c4f-4219-b726-a43badb25c55 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:39.867587 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-e3732802-9532-4e38-bec0-2cbd3025a4be req-cb496785-3c4f-4219-b726-a43badb25c55 service nova] Creating event network-vif-deleted:486a8286-8bd4-4826-a629-5c1b4c9df0e1 for instance 54a71380-34c3-40b5-a376-1622f1e44528 on hv-cinder-86248 Oct 24 13:19:39.916766 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-e3732802-9532-4e38-bec0-2cbd3025a4be req-cb496785-3c4f-4219-b726-a43badb25c55 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124923 Oct 24 13:19:39.921126 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 462/898] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 24 13:19:40.683908 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-d2e9719c-35df-431a-9b9e-a87ff8abf843 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:40.699530 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-d2e9719c-35df-431a-9b9e-a87ff8abf843 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:40.717533 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d2e9719c-35df-431a-9b9e-a87ff8abf843 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:40.718742 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d2e9719c-35df-431a-9b9e-a87ff8abf843 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:40.719519 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d2e9719c-35df-431a-9b9e-a87ff8abf843 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:40.720566 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d2e9719c-35df-431a-9b9e-a87ff8abf843 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:40.721254 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d2e9719c-35df-431a-9b9e-a87ff8abf843 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:40.721955 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-d2e9719c-35df-431a-9b9e-a87ff8abf843 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:40.743171 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-d2e9719c-35df-431a-9b9e-a87ff8abf843 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] HTTP exception thrown: Instance 54a71380-34c3-40b5-a376-1622f1e44528 could not be found. Oct 24 13:19:40.744976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-d2e9719c-35df-431a-9b9e-a87ff8abf843 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Request method failure captured: Oct 24 13:19:40.744976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 HTTP/1.1 Oct 24 13:19:40.744976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:19:40.744976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:19:40.744976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:19:40.744976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:19:40.744976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:19:40.744976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:19:40.744976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:19:40.744976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:19:40.744976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo9CWYWM4UF-UyHcTK9jrAEuWD7kYiZrWlsOb5-EbP16Pf_2_sxKAYMRnnCp8fAU3d8tio5PiGm13bpXgRLj7HBYk2HvAAI8moGL8UX4b_JXSgVZ-FvHhfjqmd2-sNxAIwSiIFkIy71RHjfpjPwPWKu_n0qMo2vAVfLTrwQ6cySdG-4 Oct 24 13:19:40.744976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:19:40.744976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:19:40.744976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:19:40.744976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:19:40.744976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 13:19:40.744976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:19:40.744976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:19:40.744976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: b736b09b6ee2492590cbc23db48752f4 Oct 24 13:19:40.744976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1585260718 Oct 24 13:19:40.744976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:19:40.744976 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:19:40.746838 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:19:40.746838 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1585260718 Oct 24 13:19:40.746838 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: b736b09b6ee2492590cbc23db48752f4 Oct 24 13:19:40.746838 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1585260718 Oct 24 13:19:40.746838 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-AttachVolumeShelveTestJSON-1585260718-project Oct 24 13:19:40.746838 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:19:40.746838 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:19:40.746838 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: 3e02f6f701324af6b53762569f1a9d21 Oct 24 13:19:40.746838 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1585260718-project Oct 24 13:19:40.746838 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:19:40.746838 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Instance 54a71380-34c3-40b5-a376-1622f1e44528 could not be found. Oct 24 13:19:40.746838 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': '54a71380-34c3-40b5-a376-1622f1e44528'} Oct 24 13:19:40.751077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:40.751077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:40.751077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:19:40.751077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:19:40.751077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:19:40.751077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:19:40.751077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:19:40.751077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:19:40.751077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:19:40.751077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:19:40.751077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54a71380-34c3-40b5-a376-1622f1e44528 could not be found. Oct 24 13:19:40.751077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:40.751077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:40.751077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:40.751077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:40.751077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:40.751077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:40.751077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:40.751077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:40.751077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:40.754168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:40.754168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:19:40.754168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:19:40.754168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:19:40.754168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:19:40.754168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:19:40.754168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:40.754168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54a71380-34c3-40b5-a376-1622f1e44528 could not be found. Oct 24 13:19:40.754168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:40.754168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:40.754168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:40.754168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:40.754168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:40.754168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:40.754168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:40.754168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:40.754168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54a71380-34c3-40b5-a376-1622f1e44528 could not be found. Oct 24 13:19:40.754168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:40.755517 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-d2e9719c-35df-431a-9b9e-a87ff8abf843 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Returning 404 to user: Instance 54a71380-34c3-40b5-a376-1622f1e44528 could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:40.755517 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-d2e9719c-35df-431a-9b9e-a87ff8abf843 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 404 len: 111 microversion: 2.20 time: 0.067556 Oct 24 13:19:40.755517 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 437/899] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:19:40 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:19:40.765008 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-4e9cf11e-f8ff-45e0-a952-02cfb5224e3e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '.version_select at 0x7fad2859a790>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:40.806263 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-4e9cf11e-f8ff-45e0-a952-02cfb5224e3e tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-506177972" status: 204 len: 0 microversion: 2.20 time: 0.052190 Oct 24 13:19:40.808063 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 463/900] 10.222.0.42 () {60 vars in 1259 bytes} [Mon Oct 24 13:19:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-506177972 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 24 13:19:42.905830 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-36e77137-5967-4910-a3ab-63cd10a4dc60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:42.906459 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-36e77137-5967-4910-a3ab-63cd10a4dc60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:42.913718 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-36e77137-5967-4910-a3ab-63cd10a4dc60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:42.914203 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-36e77137-5967-4910-a3ab-63cd10a4dc60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:42.914632 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-36e77137-5967-4910-a3ab-63cd10a4dc60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:42.915345 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-36e77137-5967-4910-a3ab-63cd10a4dc60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:42.915797 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-36e77137-5967-4910-a3ab-63cd10a4dc60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:42.916318 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-36e77137-5967-4910-a3ab-63cd10a4dc60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:42.930047 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-36e77137-5967-4910-a3ab-63cd10a4dc60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] HTTP exception thrown: Instance 54a71380-34c3-40b5-a376-1622f1e44528 could not be found. Oct 24 13:19:42.931675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-36e77137-5967-4910-a3ab-63cd10a4dc60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Request method failure captured: Oct 24 13:19:42.931675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: DELETE /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 HTTP/1.1 Oct 24 13:19:42.931675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:19:42.931675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:19:42.931675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:19:42.931675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:19:42.931675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:19:42.931675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:19:42.931675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:19:42.931675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:19:42.931675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo9CWYWM4UF-UyHcTK9jrAEuWD7kYiZrWlsOb5-EbP16Pf_2_sxKAYMRnnCp8fAU3d8tio5PiGm13bpXgRLj7HBYk2HvAAI8moGL8UX4b_JXSgVZ-FvHhfjqmd2-sNxAIwSiIFkIy71RHjfpjPwPWKu_n0qMo2vAVfLTrwQ6cySdG-4 Oct 24 13:19:42.931675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:19:42.931675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:19:42.931675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:19:42.931675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:19:42.931675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 13:19:42.931675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:19:42.931675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:19:42.931675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: b736b09b6ee2492590cbc23db48752f4 Oct 24 13:19:42.931675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1585260718 Oct 24 13:19:42.931675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:19:42.931675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:19:42.933327 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:19:42.933327 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1585260718 Oct 24 13:19:42.933327 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: b736b09b6ee2492590cbc23db48752f4 Oct 24 13:19:42.933327 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1585260718 Oct 24 13:19:42.933327 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-AttachVolumeShelveTestJSON-1585260718-project Oct 24 13:19:42.933327 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:19:42.933327 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:19:42.933327 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: 3e02f6f701324af6b53762569f1a9d21 Oct 24 13:19:42.933327 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1585260718-project Oct 24 13:19:42.933327 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:19:42.933327 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Instance 54a71380-34c3-40b5-a376-1622f1e44528 could not be found. Oct 24 13:19:42.933327 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': '54a71380-34c3-40b5-a376-1622f1e44528'} Oct 24 13:19:42.934092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:42.934092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:42.934092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:19:42.934092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:19:42.934092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:19:42.934092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:19:42.934092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:19:42.934092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:19:42.934092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:19:42.934092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:19:42.934092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54a71380-34c3-40b5-a376-1622f1e44528 could not be found. Oct 24 13:19:42.934092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:42.934092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:42.934092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:42.934092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:42.934092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:42.934092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:42.934092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:42.934092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:42.934092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:42.935409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:42.935409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:19:42.935409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:19:42.935409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:19:42.935409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:19:42.935409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:19:42.935409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:19:42.935409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:19:42.935409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:42.935409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54a71380-34c3-40b5-a376-1622f1e44528 could not be found. Oct 24 13:19:42.935409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:42.935409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:42.935409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:42.935409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:42.935409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:42.935409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:42.935409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:42.935409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:42.935409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54a71380-34c3-40b5-a376-1622f1e44528 could not be found. Oct 24 13:19:42.935409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:42.937118 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-36e77137-5967-4910-a3ab-63cd10a4dc60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Returning 404 to user: Instance 54a71380-34c3-40b5-a376-1622f1e44528 could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:42.937118 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-36e77137-5967-4910-a3ab-63cd10a4dc60 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "DELETE /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 404 len: 111 microversion: 2.20 time: 0.031156 Oct 24 13:19:42.937118 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 438/901] 10.222.0.42 () {60 vars in 1280 bytes} [Mon Oct 24 13:19:42 2022] DELETE /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:19:42.942396 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-957aa8de-d88d-4bfb-8ecd-3b4ecaa44e3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:42.943167 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-957aa8de-d88d-4bfb-8ecd-3b4ecaa44e3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 54a71380-34c3-40b5-a376-1622f1e44528] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:42.949760 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-957aa8de-d88d-4bfb-8ecd-3b4ecaa44e3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:42.950245 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-957aa8de-d88d-4bfb-8ecd-3b4ecaa44e3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:42.950682 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-957aa8de-d88d-4bfb-8ecd-3b4ecaa44e3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:42.951414 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-957aa8de-d88d-4bfb-8ecd-3b4ecaa44e3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:42.951871 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-957aa8de-d88d-4bfb-8ecd-3b4ecaa44e3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:42.952294 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-957aa8de-d88d-4bfb-8ecd-3b4ecaa44e3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:42.957592 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:42.966967 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-957aa8de-d88d-4bfb-8ecd-3b4ecaa44e3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] HTTP exception thrown: Instance 54a71380-34c3-40b5-a376-1622f1e44528 could not be found. Oct 24 13:19:42.968681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-957aa8de-d88d-4bfb-8ecd-3b4ecaa44e3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Request method failure captured: Oct 24 13:19:42.968681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 HTTP/1.1 Oct 24 13:19:42.968681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:19:42.968681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:19:42.968681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:19:42.968681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:19:42.968681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:19:42.968681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:19:42.968681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:19:42.968681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:19:42.968681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVo9CWYWM4UF-UyHcTK9jrAEuWD7kYiZrWlsOb5-EbP16Pf_2_sxKAYMRnnCp8fAU3d8tio5PiGm13bpXgRLj7HBYk2HvAAI8moGL8UX4b_JXSgVZ-FvHhfjqmd2-sNxAIwSiIFkIy71RHjfpjPwPWKu_n0qMo2vAVfLTrwQ6cySdG-4 Oct 24 13:19:42.968681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:19:42.968681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:19:42.968681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:19:42.968681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:19:42.968681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 13:19:42.968681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:19:42.968681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:19:42.968681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: b736b09b6ee2492590cbc23db48752f4 Oct 24 13:19:42.968681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1585260718 Oct 24 13:19:42.968681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:19:42.968681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:19:42.970069 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:19:42.970069 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1585260718 Oct 24 13:19:42.970069 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: b736b09b6ee2492590cbc23db48752f4 Oct 24 13:19:42.970069 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1585260718 Oct 24 13:19:42.970069 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-AttachVolumeShelveTestJSON-1585260718-project Oct 24 13:19:42.970069 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:19:42.970069 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:19:42.970069 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: 3e02f6f701324af6b53762569f1a9d21 Oct 24 13:19:42.970069 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1585260718-project Oct 24 13:19:42.970069 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:19:42.970069 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Instance 54a71380-34c3-40b5-a376-1622f1e44528 could not be found. Oct 24 13:19:42.970069 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': '54a71380-34c3-40b5-a376-1622f1e44528'} Oct 24 13:19:42.970814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:42.970814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:42.970814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:19:42.970814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:19:42.970814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:19:42.970814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:19:42.970814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:19:42.970814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:19:42.970814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:19:42.970814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:19:42.970814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54a71380-34c3-40b5-a376-1622f1e44528 could not be found. Oct 24 13:19:42.970814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:42.970814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:42.970814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:42.970814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:42.970814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:42.970814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:42.970814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:42.970814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:42.970814 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:42.973624 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:42.973624 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:19:42.973624 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:19:42.973624 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:19:42.973624 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:19:42.973624 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:19:42.973624 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:42.973624 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54a71380-34c3-40b5-a376-1622f1e44528 could not be found. Oct 24 13:19:42.973624 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:42.973624 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:42.973624 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:42.973624 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:42.973624 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:42.973624 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:42.973624 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:42.973624 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:42.973624 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54a71380-34c3-40b5-a376-1622f1e44528 could not be found. Oct 24 13:19:42.973624 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:42.975486 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-957aa8de-d88d-4bfb-8ecd-3b4ecaa44e3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Returning 404 to user: Instance 54a71380-34c3-40b5-a376-1622f1e44528 could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:42.975486 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-957aa8de-d88d-4bfb-8ecd-3b4ecaa44e3b tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528" status: 404 len: 111 microversion: 2.20 time: 0.032377 Oct 24 13:19:42.975486 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 464/902] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:19:42 2022] GET /compute/v2.1/servers/54a71380-34c3-40b5-a376-1622f1e44528 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:19:44.119585 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-167fd54b-53a9-4332-a23a-90170216e21d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:44.119585 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-167fd54b-53a9-4332-a23a-90170216e21d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:44.129339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-167fd54b-53a9-4332-a23a-90170216e21d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:44.129829 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-167fd54b-53a9-4332-a23a-90170216e21d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:44.130264 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-167fd54b-53a9-4332-a23a-90170216e21d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:44.130985 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-167fd54b-53a9-4332-a23a-90170216e21d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:44.131466 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-167fd54b-53a9-4332-a23a-90170216e21d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:44.131890 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-167fd54b-53a9-4332-a23a-90170216e21d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:44.146393 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-167fd54b-53a9-4332-a23a-90170216e21d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] HTTP exception thrown: Instance 27b5963f-5199-4822-a8c3-20a8ab09224f could not be found. Oct 24 13:19:44.147992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-167fd54b-53a9-4332-a23a-90170216e21d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Request method failure captured: Oct 24 13:19:44.147992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: DELETE /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f HTTP/1.1 Oct 24 13:19:44.147992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:19:44.147992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:19:44.147992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:19:44.147992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:19:44.147992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:19:44.147992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:19:44.147992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:19:44.147992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:19:44.147992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVo9CWYWM4UF-UyHcTK9jrAEuWD7kYiZrWlsOb5-EbP16Pf_2_sxKAYMRnnCp8fAU3d8tio5PiGm13bpXgRLj7HBYk2HvAAI8moGL8UX4b_JXSgVZ-FvHhfjqmd2-sNxAIwSiIFkIy71RHjfpjPwPWKu_n0qMo2vAVfLTrwQ6cySdG-4 Oct 24 13:19:44.147992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:19:44.147992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:19:44.147992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:19:44.147992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:19:44.147992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 13:19:44.147992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:19:44.147992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:19:44.147992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: b736b09b6ee2492590cbc23db48752f4 Oct 24 13:19:44.147992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1585260718 Oct 24 13:19:44.147992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:19:44.147992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:19:44.149526 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:19:44.149526 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1585260718 Oct 24 13:19:44.149526 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: b736b09b6ee2492590cbc23db48752f4 Oct 24 13:19:44.149526 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1585260718 Oct 24 13:19:44.149526 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-AttachVolumeShelveTestJSON-1585260718-project Oct 24 13:19:44.149526 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:19:44.149526 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:19:44.149526 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: 3e02f6f701324af6b53762569f1a9d21 Oct 24 13:19:44.149526 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1585260718-project Oct 24 13:19:44.149526 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:19:44.149526 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Instance 27b5963f-5199-4822-a8c3-20a8ab09224f could not be found. Oct 24 13:19:44.149526 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': '27b5963f-5199-4822-a8c3-20a8ab09224f'} Oct 24 13:19:44.153295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:44.153295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:44.153295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:19:44.153295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:19:44.153295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:19:44.153295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:19:44.153295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:19:44.153295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:19:44.153295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:19:44.153295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:19:44.153295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27b5963f-5199-4822-a8c3-20a8ab09224f could not be found. Oct 24 13:19:44.153295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:44.153295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:44.153295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:44.153295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:44.153295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:44.153295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:44.153295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:44.153295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:44.153295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:44.154652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:44.154652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:19:44.154652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:19:44.154652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:19:44.154652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:19:44.154652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:19:44.154652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:19:44.154652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:19:44.154652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:44.154652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27b5963f-5199-4822-a8c3-20a8ab09224f could not be found. Oct 24 13:19:44.154652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:44.154652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:44.154652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:44.154652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:44.154652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:44.154652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:44.154652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:44.154652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:44.154652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27b5963f-5199-4822-a8c3-20a8ab09224f could not be found. Oct 24 13:19:44.154652 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:44.155940 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-167fd54b-53a9-4332-a23a-90170216e21d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Returning 404 to user: Instance 27b5963f-5199-4822-a8c3-20a8ab09224f could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:44.155940 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-167fd54b-53a9-4332-a23a-90170216e21d tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "DELETE /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 404 len: 111 microversion: 2.20 time: 0.034809 Oct 24 13:19:44.155940 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 439/903] 10.222.0.42 () {60 vars in 1280 bytes} [Mon Oct 24 13:19:44 2022] DELETE /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:19:44.157980 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-80d98414-284c-4bb2-9a61-8d72a1d1e1b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:44.158608 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-80d98414-284c-4bb2-9a61-8d72a1d1e1b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] [instance: 27b5963f-5199-4822-a8c3-20a8ab09224f] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:44.169912 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-80d98414-284c-4bb2-9a61-8d72a1d1e1b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:44.170410 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-80d98414-284c-4bb2-9a61-8d72a1d1e1b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:44.170847 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-80d98414-284c-4bb2-9a61-8d72a1d1e1b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:44.171925 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-80d98414-284c-4bb2-9a61-8d72a1d1e1b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:44.172942 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-80d98414-284c-4bb2-9a61-8d72a1d1e1b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:44.173551 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-80d98414-284c-4bb2-9a61-8d72a1d1e1b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:44.212661 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-80d98414-284c-4bb2-9a61-8d72a1d1e1b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] HTTP exception thrown: Instance 27b5963f-5199-4822-a8c3-20a8ab09224f could not be found. Oct 24 13:19:44.214216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-80d98414-284c-4bb2-9a61-8d72a1d1e1b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Request method failure captured: Oct 24 13:19:44.214216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f HTTP/1.1 Oct 24 13:19:44.214216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:19:44.214216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:19:44.214216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:19:44.214216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:19:44.214216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:19:44.214216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:19:44.214216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:19:44.214216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:19:44.214216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVo9CWYWM4UF-UyHcTK9jrAEuWD7kYiZrWlsOb5-EbP16Pf_2_sxKAYMRnnCp8fAU3d8tio5PiGm13bpXgRLj7HBYk2HvAAI8moGL8UX4b_JXSgVZ-FvHhfjqmd2-sNxAIwSiIFkIy71RHjfpjPwPWKu_n0qMo2vAVfLTrwQ6cySdG-4 Oct 24 13:19:44.214216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:19:44.214216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:19:44.214216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:19:44.214216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:19:44.214216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Openstack-Nova-Api-Version: 2.20 Oct 24 13:19:44.214216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:19:44.214216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:19:44.214216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: b736b09b6ee2492590cbc23db48752f4 Oct 24 13:19:44.214216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1585260718 Oct 24 13:19:44.214216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:19:44.214216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:19:44.215978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b736b09b6ee2492590cbc23db48752f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:19:44.215978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1585260718 Oct 24 13:19:44.215978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: b736b09b6ee2492590cbc23db48752f4 Oct 24 13:19:44.215978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1585260718 Oct 24 13:19:44.215978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-AttachVolumeShelveTestJSON-1585260718-project Oct 24 13:19:44.215978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:19:44.215978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:19:44.215978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: 3e02f6f701324af6b53762569f1a9d21 Oct 24 13:19:44.215978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1585260718-project Oct 24 13:19:44.215978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:19:44.215978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Instance 27b5963f-5199-4822-a8c3-20a8ab09224f could not be found. Oct 24 13:19:44.215978 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': '27b5963f-5199-4822-a8c3-20a8ab09224f'} Oct 24 13:19:44.216857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:44.216857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:44.216857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:19:44.216857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:19:44.216857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:19:44.216857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:19:44.216857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:19:44.216857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:19:44.216857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:19:44.216857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:19:44.216857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27b5963f-5199-4822-a8c3-20a8ab09224f could not be found. Oct 24 13:19:44.216857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:44.216857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:44.216857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:44.216857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:44.216857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:44.216857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:44.216857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:44.216857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:44.216857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:44.218272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:44.218272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:19:44.218272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:19:44.218272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:19:44.218272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:19:44.218272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:19:44.218272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:44.218272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27b5963f-5199-4822-a8c3-20a8ab09224f could not be found. Oct 24 13:19:44.218272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:44.218272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:44.218272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:44.218272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:44.218272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:44.218272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:44.218272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:44.218272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:44.218272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27b5963f-5199-4822-a8c3-20a8ab09224f could not be found. Oct 24 13:19:44.218272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:44.219483 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-80d98414-284c-4bb2-9a61-8d72a1d1e1b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] Returning 404 to user: Instance 27b5963f-5199-4822-a8c3-20a8ab09224f could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:44.219483 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-80d98414-284c-4bb2-9a61-8d72a1d1e1b7 tempest-AttachVolumeShelveTestJSON-1585260718 tempest-AttachVolumeShelveTestJSON-1585260718-project] 10.222.0.42 "GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f" status: 404 len: 111 microversion: 2.20 time: 0.064339 Oct 24 13:19:44.223253 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 465/904] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Oct 24 13:19:44 2022] GET /compute/v2.1/servers/27b5963f-5199-4822-a8c3-20a8ab09224f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 24 13:19:46.376344 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-c3d9aeaa-4a20-4e2b-81d1-0e9a98f27ede tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1535035267", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1444731753", "security_groups": [{"name": "tempest-secgroup-smoke-956941154"}], "networks": [{"uuid": "5ecc9141-8649-4fa5-a20f-d3d036bb3062"}], "block_device_mapping_v2": [{"uuid": "aee5255f-ade2-400e-b8e9-cc6ec84d2ca7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:19:46.592686 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.network.neutron [None req-c3d9aeaa-4a20-4e2b-81d1-0e9a98f27ede tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] validate_networks() for [('5ecc9141-8649-4fa5-a20f-d3d036bb3062', None, None, None, None, None)] {{(pid=118915) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:19:47.330418 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-c3d9aeaa-4a20-4e2b-81d1-0e9a98f27ede tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Flavor limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:19:47.330865 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-c3d9aeaa-4a20-4e2b-81d1-0e9a98f27ede tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Image limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:19:47.331467 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-c3d9aeaa-4a20-4e2b-81d1-0e9a98f27ede tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Flavor pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:19:47.331874 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-c3d9aeaa-4a20-4e2b-81d1-0e9a98f27ede tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Image pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:19:47.332335 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-c3d9aeaa-4a20-4e2b-81d1-0e9a98f27ede tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:19:47.346187 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c3d9aeaa-4a20-4e2b-81d1-0e9a98f27ede tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:47.346672 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c3d9aeaa-4a20-4e2b-81d1-0e9a98f27ede tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:47.347129 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c3d9aeaa-4a20-4e2b-81d1-0e9a98f27ede tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:47.348391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c3d9aeaa-4a20-4e2b-81d1-0e9a98f27ede tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:47.348859 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c3d9aeaa-4a20-4e2b-81d1-0e9a98f27ede tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:47.349310 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c3d9aeaa-4a20-4e2b-81d1-0e9a98f27ede tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:47.367091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-c3d9aeaa-4a20-4e2b-81d1-0e9a98f27ede tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Getting quotas for project f0bee9967bdb41eca0acff51d5e105e9. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:19:47.371360 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-c3d9aeaa-4a20-4e2b-81d1-0e9a98f27ede tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Getting quotas for user af98e8f344914ae59852d82d176b4dc2 and project f0bee9967bdb41eca0acff51d5e105e9. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:19:47.441819 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-c3d9aeaa-4a20-4e2b-81d1-0e9a98f27ede tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Going to run 1 instances... {{(pid=118915) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:19:47.444169 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-c3d9aeaa-4a20-4e2b-81d1-0e9a98f27ede tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aee5255f-ade2-400e-b8e9-cc6ec84d2ca7',volume_size=None,volume_type=None)] {{(pid=118915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:19:47.630787 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-c3d9aeaa-4a20-4e2b-81d1-0e9a98f27ede tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.260607 Oct 24 13:19:47.631947 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 440/905] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 24 13:19:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:19:47.645235 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-f09b498e-e2d8-4fc7-92d4-22a6ae08fb58 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:47.645848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-f09b498e-e2d8-4fc7-92d4-22a6ae08fb58 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:47.727667 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-f09b498e-e2d8-4fc7-92d4-22a6ae08fb58 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:47.734941 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-f09b498e-e2d8-4fc7-92d4-22a6ae08fb58 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1089 microversion: 2.1 time: 0.094361 Oct 24 13:19:47.771984 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 466/906] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:47 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1089 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:19:48.765616 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-17aed859-c180-4f18-aa9d-fe6cec2e5bdb tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:48.766305 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-17aed859-c180-4f18-aa9d-fe6cec2e5bdb tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:48.774212 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-17aed859-c180-4f18-aa9d-fe6cec2e5bdb tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:48.774675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-17aed859-c180-4f18-aa9d-fe6cec2e5bdb tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:48.775125 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-17aed859-c180-4f18-aa9d-fe6cec2e5bdb tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:48.775828 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-17aed859-c180-4f18-aa9d-fe6cec2e5bdb tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:48.776285 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-17aed859-c180-4f18-aa9d-fe6cec2e5bdb tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:48.776760 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-17aed859-c180-4f18-aa9d-fe6cec2e5bdb tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:48.845204 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-17aed859-c180-4f18-aa9d-fe6cec2e5bdb tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:48.853250 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-17aed859-c180-4f18-aa9d-fe6cec2e5bdb tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1187 microversion: 2.1 time: 0.092261 Oct 24 13:19:48.854010 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 441/907] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:48 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:19:49.878394 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-fe99390f-cac2-4aa6-85cd-b45cbe46a939 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:49.879688 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-fe99390f-cac2-4aa6-85cd-b45cbe46a939 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:49.888457 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fe99390f-cac2-4aa6-85cd-b45cbe46a939 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:49.889763 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fe99390f-cac2-4aa6-85cd-b45cbe46a939 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:49.890377 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fe99390f-cac2-4aa6-85cd-b45cbe46a939 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:49.891512 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fe99390f-cac2-4aa6-85cd-b45cbe46a939 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:49.893511 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fe99390f-cac2-4aa6-85cd-b45cbe46a939 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:49.894123 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fe99390f-cac2-4aa6-85cd-b45cbe46a939 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:49.977994 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-f89f9984-f56e-462e-83d0-28574ea7f898 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Action: 'create', calling method: .version_select at 0x7fad283fddc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-598626713"}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:19:50.161799 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-fe99390f-cac2-4aa6-85cd-b45cbe46a939 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:50.172878 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-fe99390f-cac2-4aa6-85cd-b45cbe46a939 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1260 microversion: 2.1 time: 0.299505 Oct 24 13:19:50.174661 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 442/908] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:49 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1260 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:19:50.356292 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-f89f9984-f56e-462e-83d0-28574ea7f898 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.582603 Oct 24 13:19:50.357812 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 467/909] 10.222.0.42 () {60 vars in 1155 bytes} [Mon Oct 24 13:19:49 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 585 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 24 13:19:50.372639 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-ae61abc3-0731-4a8c-a9d6-cd699499e593 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Calling method '.version_select at 0x7fad282b38b0>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:50.435808 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-ae61abc3-0731-4a8c-a9d6-cd699499e593 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/aeb4c602-60dd-430e-927f-8b1d25fd960f" status: 200 len: 344 microversion: 2.1 time: 0.068473 Oct 24 13:19:50.436389 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 443/910] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 24 13:19:50 2022] GET /compute/v2.1/os-volumes/aeb4c602-60dd-430e-927f-8b1d25fd960f => generated 344 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:50.724140 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-df8d2373-c089-43de-9c59-50249569cf35 req-92a44160-873c-46a1-841c-802567e90728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8", "tag": "7ee73beb-73a9-4d41-969d-8ee93d5f0945"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:19:50.733322 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-df8d2373-c089-43de-9c59-50249569cf35 req-92a44160-873c-46a1-841c-802567e90728 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:50.733792 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-df8d2373-c089-43de-9c59-50249569cf35 req-92a44160-873c-46a1-841c-802567e90728 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:50.734215 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-df8d2373-c089-43de-9c59-50249569cf35 req-92a44160-873c-46a1-841c-802567e90728 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:50.745657 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-df8d2373-c089-43de-9c59-50249569cf35 req-92a44160-873c-46a1-841c-802567e90728 service nova] Creating event network-changed:7ee73beb-73a9-4d41-969d-8ee93d5f0945 for instance 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 on hv-cinder-86248 Oct 24 13:19:50.750652 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-df8d2373-c089-43de-9c59-50249569cf35 req-92a44160-873c-46a1-841c-802567e90728 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031054 Oct 24 13:19:50.751326 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 468/911] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:51.198231 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-5e03e03a-6437-4dad-9bff-49d885e856e0 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:51.198845 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-5e03e03a-6437-4dad-9bff-49d885e856e0 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:51.204711 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5e03e03a-6437-4dad-9bff-49d885e856e0 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:51.205188 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5e03e03a-6437-4dad-9bff-49d885e856e0 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:51.205779 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5e03e03a-6437-4dad-9bff-49d885e856e0 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:51.206554 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5e03e03a-6437-4dad-9bff-49d885e856e0 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:51.207005 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5e03e03a-6437-4dad-9bff-49d885e856e0 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:51.207447 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5e03e03a-6437-4dad-9bff-49d885e856e0 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:51.340701 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-5e03e03a-6437-4dad-9bff-49d885e856e0 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:51.348826 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-5e03e03a-6437-4dad-9bff-49d885e856e0 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1260 microversion: 2.1 time: 0.154873 Oct 24 13:19:51.349389 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 444/912] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:51 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:19:51.451513 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-44c611b6-c32e-4263-81de-20bb3b13a467 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Calling method '.version_select at 0x7fad2859a820>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:51.501561 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-44c611b6-c32e-4263-81de-20bb3b13a467 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/aeb4c602-60dd-430e-927f-8b1d25fd960f" status: 200 len: 344 microversion: 2.1 time: 0.054151 Oct 24 13:19:51.502139 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 469/913] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 24 13:19:51 2022] GET /compute/v2.1/os-volumes/aeb4c602-60dd-430e-927f-8b1d25fd960f => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:52.371874 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-e82b55de-bc2f-48bb-9509-f2d5a9602a21 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:52.372482 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-e82b55de-bc2f-48bb-9509-f2d5a9602a21 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:52.379414 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e82b55de-bc2f-48bb-9509-f2d5a9602a21 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:52.379898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e82b55de-bc2f-48bb-9509-f2d5a9602a21 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:52.380333 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e82b55de-bc2f-48bb-9509-f2d5a9602a21 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:52.381021 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e82b55de-bc2f-48bb-9509-f2d5a9602a21 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:52.381473 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e82b55de-bc2f-48bb-9509-f2d5a9602a21 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:52.381896 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e82b55de-bc2f-48bb-9509-f2d5a9602a21 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:52.517034 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-e0c1eb8a-2b47-406b-a37d-01234463f4fc tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Calling method '.version_select at 0x7fad283fd280>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:52.579879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-e0c1eb8a-2b47-406b-a37d-01234463f4fc tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/aeb4c602-60dd-430e-927f-8b1d25fd960f" status: 200 len: 344 microversion: 2.1 time: 0.067097 Oct 24 13:19:52.581265 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 470/914] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 24 13:19:52 2022] GET /compute/v2.1/os-volumes/aeb4c602-60dd-430e-927f-8b1d25fd960f => generated 344 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:52.650955 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-e82b55de-bc2f-48bb-9509-f2d5a9602a21 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:52.658615 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-e82b55de-bc2f-48bb-9509-f2d5a9602a21 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1260 microversion: 2.1 time: 0.290543 Oct 24 13:19:52.659427 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 445/915] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:52 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1260 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:19:53.595635 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-258ec85d-cd27-43b8-b030-5c45f6aec5d2 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Calling method '.version_select at 0x7fad2841ca60>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:53.645901 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-258ec85d-cd27-43b8-b030-5c45f6aec5d2 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/aeb4c602-60dd-430e-927f-8b1d25fd960f" status: 200 len: 345 microversion: 2.1 time: 0.054977 Oct 24 13:19:53.646596 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 471/916] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 24 13:19:53 2022] GET /compute/v2.1/os-volumes/aeb4c602-60dd-430e-927f-8b1d25fd960f => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:53.660003 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-fa64698c-0315-49f5-9147-bffb27abf265 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Action: 'create', calling method: .version_select at 0x7fad284d8dc0>, body: {"snapshot": {"volume_id": "aeb4c602-60dd-430e-927f-8b1d25fd960f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-440724036"}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:19:53.685519 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c6e4e340-378d-4e9c-a422-32baca3bef33 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:53.686365 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-c6e4e340-378d-4e9c-a422-32baca3bef33 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:53.694784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c6e4e340-378d-4e9c-a422-32baca3bef33 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:53.701435 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c6e4e340-378d-4e9c-a422-32baca3bef33 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:53.702449 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c6e4e340-378d-4e9c-a422-32baca3bef33 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:53.703342 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c6e4e340-378d-4e9c-a422-32baca3bef33 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:53.703938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c6e4e340-378d-4e9c-a422-32baca3bef33 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:53.704466 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c6e4e340-378d-4e9c-a422-32baca3bef33 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:53.834595 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-fa64698c-0315-49f5-9147-bffb27abf265 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.178899 Oct 24 13:19:53.835518 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 446/917] 10.222.0.42 () {60 vars in 1162 bytes} [Mon Oct 24 13:19:53 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:53.847003 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-746abc09-1074-446d-9f34-07de6fdb72e5 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Calling method '.version_select at 0x7fad286063a0>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:53.896363 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-c6e4e340-378d-4e9c-a422-32baca3bef33 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:53.904565 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-746abc09-1074-446d-9f34-07de6fdb72e5 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/9eac8f0a-f788-4074-94c3-2ae5008aff9c" status: 200 len: 286 microversion: 2.1 time: 0.061951 Oct 24 13:19:53.905461 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 447/918] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Oct 24 13:19:53 2022] GET /compute/v2.1/os-snapshots/9eac8f0a-f788-4074-94c3-2ae5008aff9c => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:53.909696 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-c6e4e340-378d-4e9c-a422-32baca3bef33 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1260 microversion: 2.1 time: 0.228217 Oct 24 13:19:53.911559 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 472/919] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:53 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:19:53.917377 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-7665e919-1cc2-45e0-a833-ac1d59ca190a tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Calling method '.version_select at 0x7fad28903ca0>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:53.981113 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-7665e919-1cc2-45e0-a833-ac1d59ca190a tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.067820 Oct 24 13:19:53.981688 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 448/920] 10.222.0.42 () {58 vars in 1140 bytes} [Mon Oct 24 13:19:53 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:53.995339 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-605c86f3-96b1-4bad-9c75-388bcfa3f89b tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Calling method '.version_select at 0x7fad283fd5e0>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:54.066954 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-605c86f3-96b1-4bad-9c75-388bcfa3f89b tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/9eac8f0a-f788-4074-94c3-2ae5008aff9c" status: 200 len: 286 microversion: 2.1 time: 0.077388 Oct 24 13:19:54.081734 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 473/921] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Oct 24 13:19:53 2022] GET /compute/v2.1/os-snapshots/9eac8f0a-f788-4074-94c3-2ae5008aff9c => generated 286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:54.935321 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-66058462-7e6c-4f16-9317-d02a2088ef40 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:54.935935 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-66058462-7e6c-4f16-9317-d02a2088ef40 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:54.941999 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-66058462-7e6c-4f16-9317-d02a2088ef40 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:54.942476 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-66058462-7e6c-4f16-9317-d02a2088ef40 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:54.942908 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-66058462-7e6c-4f16-9317-d02a2088ef40 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:54.943697 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-66058462-7e6c-4f16-9317-d02a2088ef40 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:54.944154 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-66058462-7e6c-4f16-9317-d02a2088ef40 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:54.944577 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-66058462-7e6c-4f16-9317-d02a2088ef40 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:55.074337 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-66058462-7e6c-4f16-9317-d02a2088ef40 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:55.082907 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-66058462-7e6c-4f16-9317-d02a2088ef40 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1260 microversion: 2.1 time: 0.152114 Oct 24 13:19:55.083512 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 449/922] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:54 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:19:55.084710 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-01d64c24-75f9-4e92-b9d6-39c8e8492840 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Calling method '.version_select at 0x7fad285a75e0>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:55.113891 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-01d64c24-75f9-4e92-b9d6-39c8e8492840 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/9eac8f0a-f788-4074-94c3-2ae5008aff9c" status: 200 len: 286 microversion: 2.1 time: 0.034440 Oct 24 13:19:55.114467 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 474/923] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Oct 24 13:19:55 2022] GET /compute/v2.1/os-snapshots/9eac8f0a-f788-4074-94c3-2ae5008aff9c => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:19:56.105793 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-c46fb183-ba67-42da-a7c7-23bda115bb76 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:56.106441 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-c46fb183-ba67-42da-a7c7-23bda115bb76 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:56.113779 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c46fb183-ba67-42da-a7c7-23bda115bb76 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:56.114252 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c46fb183-ba67-42da-a7c7-23bda115bb76 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:56.114679 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c46fb183-ba67-42da-a7c7-23bda115bb76 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:56.115393 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c46fb183-ba67-42da-a7c7-23bda115bb76 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:56.115847 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c46fb183-ba67-42da-a7c7-23bda115bb76 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:56.116263 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c46fb183-ba67-42da-a7c7-23bda115bb76 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:56.127630 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-24beaec8-decd-4d0f-a5be-0c9e1e3d8d23 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Calling method '.version_select at 0x7fad2859a4c0>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:56.158020 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-24beaec8-decd-4d0f-a5be-0c9e1e3d8d23 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/9eac8f0a-f788-4074-94c3-2ae5008aff9c" status: 200 len: 286 microversion: 2.1 time: 0.035155 Oct 24 13:19:56.159485 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 475/924] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Oct 24 13:19:56 2022] GET /compute/v2.1/os-snapshots/9eac8f0a-f788-4074-94c3-2ae5008aff9c => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:19:56.252290 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-c46fb183-ba67-42da-a7c7-23bda115bb76 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:56.254610 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:56.262383 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-c46fb183-ba67-42da-a7c7-23bda115bb76 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1260 microversion: 2.1 time: 0.160341 Oct 24 13:19:56.263201 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 450/925] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:56 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:19:57.172110 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a68d248b-5cb4-4d97-a0e6-35ab76957d27 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Calling method '.version_select at 0x7fad285a70d0>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:57.202571 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a68d248b-5cb4-4d97-a0e6-35ab76957d27 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/9eac8f0a-f788-4074-94c3-2ae5008aff9c" status: 200 len: 287 microversion: 2.1 time: 0.034669 Oct 24 13:19:57.203152 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 476/926] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Oct 24 13:19:57 2022] GET /compute/v2.1/os-snapshots/9eac8f0a-f788-4074-94c3-2ae5008aff9c => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:57.214070 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-521bcb17-0275-488c-8a0a-39e2956b52e4 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Calling method '.version_select at 0x7fad287e8430>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:57.272046 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-521bcb17-0275-488c-8a0a-39e2956b52e4 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/9eac8f0a-f788-4074-94c3-2ae5008aff9c" status: 202 len: 0 microversion: 2.1 time: 0.061590 Oct 24 13:19:57.272705 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 451/927] 10.222.0.42 () {58 vars in 1254 bytes} [Mon Oct 24 13:19:57 2022] DELETE /compute/v2.1/os-snapshots/9eac8f0a-f788-4074-94c3-2ae5008aff9c => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:19:57.281061 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-969b30d9-1cfa-466f-8f60-ac7d796d04c8 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Calling method '.version_select at 0x7fad2845f700>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:57.284400 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-7a9e9a3b-fcb0-4206-bced-167ca5c3e96c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:57.285001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-7a9e9a3b-fcb0-4206-bced-167ca5c3e96c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:57.291112 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7a9e9a3b-fcb0-4206-bced-167ca5c3e96c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:57.291590 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7a9e9a3b-fcb0-4206-bced-167ca5c3e96c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:57.292023 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7a9e9a3b-fcb0-4206-bced-167ca5c3e96c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:57.292703 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7a9e9a3b-fcb0-4206-bced-167ca5c3e96c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:57.293173 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7a9e9a3b-fcb0-4206-bced-167ca5c3e96c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:57.293588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7a9e9a3b-fcb0-4206-bced-167ca5c3e96c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:57.313914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-969b30d9-1cfa-466f-8f60-ac7d796d04c8 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/9eac8f0a-f788-4074-94c3-2ae5008aff9c" status: 200 len: 286 microversion: 2.1 time: 0.036578 Oct 24 13:19:57.315243 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 477/928] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Oct 24 13:19:57 2022] GET /compute/v2.1/os-snapshots/9eac8f0a-f788-4074-94c3-2ae5008aff9c => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:57.357244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=2 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:57.377802 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=6 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:57.438091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-7a9e9a3b-fcb0-4206-bced-167ca5c3e96c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:57.446581 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-7a9e9a3b-fcb0-4206-bced-167ca5c3e96c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1260 microversion: 2.1 time: 0.165801 Oct 24 13:19:57.447256 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 452/929] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:57 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:19:58.324903 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=2 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:19:58.329522 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-08d4301d-36d0-499c-9d2f-8b966ec100e7 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Calling method '.version_select at 0x7fad2848a700>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:58.354887 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-08d4301d-36d0-499c-9d2f-8b966ec100e7 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] HTTP exception thrown: Snapshot 9eac8f0a-f788-4074-94c3-2ae5008aff9c could not be found. Oct 24 13:19:58.357181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-08d4301d-36d0-499c-9d2f-8b966ec100e7 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Request method failure captured: Oct 24 13:19:58.357181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: GET /compute/v2.1/os-snapshots/9eac8f0a-f788-4074-94c3-2ae5008aff9c HTTP/1.1 Oct 24 13:19:58.357181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:19:58.357181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:19:58.357181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:19:58.357181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:19:58.357181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:19:58.357181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:19:58.357181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:19:58.357181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:19:58.357181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVpD13ShzO2hZ9Kw8hMS7uqSkBP05a8q6JQsVOUjwh3w992Mr5gZa8k10mFYD3XHMCZhiXq5amyG_l08bs6p-6k-N-LKlh4pO_r6cGQh_Us3Js7_NPj5n3HURTjglvzDPa_WnDDiZDXh025ctRcZUNFEKfkR9dYPVYDAwYfLBX3Jxf8o Oct 24 13:19:58.357181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:19:58.357181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:19:58.357181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:19:58.357181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:19:58.357181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:19:58.357181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:19:58.357181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: 4edaa125c0154653b7b698cc42630b0d Oct 24 13:19:58.357181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1162507390 Oct 24 13:19:58.357181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:19:58.357181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:19:58.358881 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4edaa125c0154653b7b698cc42630b0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4edaa125c0154653b7b698cc42630b0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4edaa125c0154653b7b698cc42630b0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4edaa125c0154653b7b698cc42630b0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:19:58.358881 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1162507390 Oct 24 13:19:58.358881 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: 4edaa125c0154653b7b698cc42630b0d Oct 24 13:19:58.358881 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1162507390 Oct 24 13:19:58.358881 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-VolumesSnapshotsTestJSON-1162507390-project Oct 24 13:19:58.358881 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:19:58.358881 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:19:58.358881 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: abfbfe6583274bd88e90d7007a7c90a8 Oct 24 13:19:58.358881 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1162507390-project Oct 24 13:19:58.358881 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: Oct 24 13:19:58.358881 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Snapshot 9eac8f0a-f788-4074-94c3-2ae5008aff9c could not be found. Oct 24 13:19:58.358881 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': '9eac8f0a-f788-4074-94c3-2ae5008aff9c'} Oct 24 13:19:58.358881 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:58.359970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:58.359970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 24 13:19:58.359970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 24 13:19:58.359970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 24 13:19:58.359970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 24 13:19:58.359970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 24 13:19:58.359970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 24 13:19:58.359970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:19:58.359970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:19:58.359970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:19:58.359970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:19:58.359970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:19:58.359970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:19:58.359970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:19:58.359970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:19:58.359970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9eac8f0a-f788-4074-94c3-2ae5008aff9c could not be found. (HTTP 404) (Request-ID: req-83c3331f-dd68-4e28-9605-229bc7b910fd) Oct 24 13:19:58.359970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:58.359970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:58.361379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:58.361379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:58.361379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 24 13:19:58.361379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 24 13:19:58.361379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:19:58.361379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:19:58.361379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 24 13:19:58.361379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 24 13:19:58.361379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:19:58.361379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:19:58.361379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 24 13:19:58.361379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 24 13:19:58.361379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 24 13:19:58.361379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 24 13:19:58.361379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 24 13:19:58.361379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 24 13:19:58.361379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:19:58.361379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:19:58.361379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:19:58.364146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:19:58.364146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:19:58.364146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:19:58.364146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:19:58.364146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:19:58.364146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9eac8f0a-f788-4074-94c3-2ae5008aff9c could not be found. Oct 24 13:19:58.364146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:58.364146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:58.364146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:58.364146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:58.364146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:58.364146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:58.364146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:58.364146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:58.364146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:19:58.364146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:19:58.364146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:58.364146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:58.364146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 24 13:19:58.364146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:58.365622 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9eac8f0a-f788-4074-94c3-2ae5008aff9c could not be found. Oct 24 13:19:58.365622 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:58.365622 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:58.365622 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:58.365622 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:58.365622 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:58.365622 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:58.365622 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:58.365622 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:58.365622 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9eac8f0a-f788-4074-94c3-2ae5008aff9c could not be found. Oct 24 13:19:58.365622 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:58.365622 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-08d4301d-36d0-499c-9d2f-8b966ec100e7 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Returning 404 to user: Snapshot 9eac8f0a-f788-4074-94c3-2ae5008aff9c could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:58.365622 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-08d4301d-36d0-499c-9d2f-8b966ec100e7 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/9eac8f0a-f788-4074-94c3-2ae5008aff9c" status: 404 len: 111 microversion: 2.1 time: 0.034551 Oct 24 13:19:58.366644 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 478/930] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Oct 24 13:19:58 2022] GET /compute/v2.1/os-snapshots/9eac8f0a-f788-4074-94c3-2ae5008aff9c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:19:58.368084 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-1929f057-8750-4d00-9533-81458201df3b tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Calling method '.version_select at 0x7fad287e85e0>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:58.427742 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-1929f057-8750-4d00-9533-81458201df3b tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/aeb4c602-60dd-430e-927f-8b1d25fd960f" status: 202 len: 0 microversion: 2.1 time: 0.063471 Oct 24 13:19:58.431804 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 453/931] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Oct 24 13:19:58 2022] DELETE /compute/v2.1/os-volumes/aeb4c602-60dd-430e-927f-8b1d25fd960f => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:19:58.436807 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-5991ebea-1614-4370-bb04-55134e2355c1 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Calling method '.version_select at 0x7fad2845fdc0>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:58.469920 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-3b5ea6db-55a1-4696-948b-7a00859f23f4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:58.470535 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-3b5ea6db-55a1-4696-948b-7a00859f23f4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:58.477370 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3b5ea6db-55a1-4696-948b-7a00859f23f4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:58.477863 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3b5ea6db-55a1-4696-948b-7a00859f23f4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:58.478344 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3b5ea6db-55a1-4696-948b-7a00859f23f4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:58.479115 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3b5ea6db-55a1-4696-948b-7a00859f23f4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:58.479576 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3b5ea6db-55a1-4696-948b-7a00859f23f4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:58.480004 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3b5ea6db-55a1-4696-948b-7a00859f23f4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:58.490825 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-5991ebea-1614-4370-bb04-55134e2355c1 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/aeb4c602-60dd-430e-927f-8b1d25fd960f" status: 200 len: 344 microversion: 2.1 time: 0.057860 Oct 24 13:19:58.491478 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 479/932] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 24 13:19:58 2022] GET /compute/v2.1/os-volumes/aeb4c602-60dd-430e-927f-8b1d25fd960f => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:19:58.627725 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-3b5ea6db-55a1-4696-948b-7a00859f23f4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:58.638205 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-3b5ea6db-55a1-4696-948b-7a00859f23f4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1260 microversion: 2.1 time: 0.172209 Oct 24 13:19:58.648295 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 454/933] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:58 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:19:59.506618 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-ef94b652-9775-4c34-9611-b956dc8bdd62 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Calling method '.version_select at 0x7fad2859a820>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:59.534736 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-ef94b652-9775-4c34-9611-b956dc8bdd62 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] HTTP exception thrown: Volume aeb4c602-60dd-430e-927f-8b1d25fd960f could not be found. Oct 24 13:19:59.536700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-ef94b652-9775-4c34-9611-b956dc8bdd62 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Request method failure captured: Oct 24 13:19:59.536700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: GET /compute/v2.1/os-volumes/aeb4c602-60dd-430e-927f-8b1d25fd960f HTTP/1.1 Oct 24 13:19:59.536700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:19:59.536700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:19:59.536700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:19:59.536700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:19:59.536700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:19:59.536700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:19:59.536700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:19:59.536700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:19:59.536700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVpD13ShzO2hZ9Kw8hMS7uqSkBP05a8q6JQsVOUjwh3w992Mr5gZa8k10mFYD3XHMCZhiXq5amyG_l08bs6p-6k-N-LKlh4pO_r6cGQh_Us3Js7_NPj5n3HURTjglvzDPa_WnDDiZDXh025ctRcZUNFEKfkR9dYPVYDAwYfLBX3Jxf8o Oct 24 13:19:59.536700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:19:59.536700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:19:59.536700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:19:59.536700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:19:59.536700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:19:59.536700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:19:59.536700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: 4edaa125c0154653b7b698cc42630b0d Oct 24 13:19:59.536700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1162507390 Oct 24 13:19:59.536700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:19:59.536700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:19:59.538304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4edaa125c0154653b7b698cc42630b0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4edaa125c0154653b7b698cc42630b0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4edaa125c0154653b7b698cc42630b0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4edaa125c0154653b7b698cc42630b0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:19:59.538304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1162507390 Oct 24 13:19:59.538304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: 4edaa125c0154653b7b698cc42630b0d Oct 24 13:19:59.538304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1162507390 Oct 24 13:19:59.538304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-VolumesSnapshotsTestJSON-1162507390-project Oct 24 13:19:59.538304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:19:59.538304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:19:59.538304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: abfbfe6583274bd88e90d7007a7c90a8 Oct 24 13:19:59.538304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1162507390-project Oct 24 13:19:59.538304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: Oct 24 13:19:59.538304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Volume aeb4c602-60dd-430e-927f-8b1d25fd960f could not be found. Oct 24 13:19:59.538304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': 'aeb4c602-60dd-430e-927f-8b1d25fd960f'} Oct 24 13:19:59.538304 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:59.539469 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:59.539469 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:19:59.539469 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:19:59.539469 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:19:59.539469 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:19:59.539469 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:19:59.539469 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:19:59.539469 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:19:59.539469 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:19:59.539469 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:19:59.539469 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:19:59.539469 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:19:59.539469 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:19:59.539469 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:19:59.539469 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:19:59.539469 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aeb4c602-60dd-430e-927f-8b1d25fd960f could not be found. (HTTP 404) (Request-ID: req-ac9ba18f-8db1-451f-8f5d-50c4cbcc9bbb) Oct 24 13:19:59.539469 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:59.539469 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:59.539469 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:59.540852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:59.540852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 13:19:59.540852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 13:19:59.540852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:19:59.540852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:19:59.540852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 13:19:59.540852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 13:19:59.540852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:19:59.540852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:19:59.540852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:19:59.540852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:19:59.540852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:19:59.540852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:19:59.540852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:19:59.540852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:19:59.540852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:19:59.540852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:19:59.540852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:19:59.540852 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:19:59.542212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:19:59.542212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:19:59.542212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:19:59.542212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:19:59.542212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aeb4c602-60dd-430e-927f-8b1d25fd960f could not be found. Oct 24 13:19:59.542212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:59.542212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:59.542212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:59.542212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:59.542212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:59.542212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:59.542212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:59.542212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:59.542212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:19:59.542212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:19:59.542212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:59.542212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:59.542212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 13:19:59.542212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:59.543505 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aeb4c602-60dd-430e-927f-8b1d25fd960f could not be found. Oct 24 13:19:59.543505 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:59.543505 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:59.543505 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:59.543505 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:59.543505 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:59.543505 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:59.543505 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:59.543505 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:59.543505 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aeb4c602-60dd-430e-927f-8b1d25fd960f could not be found. Oct 24 13:19:59.543505 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:59.543505 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-ef94b652-9775-4c34-9611-b956dc8bdd62 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Returning 404 to user: Volume aeb4c602-60dd-430e-927f-8b1d25fd960f could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:59.543505 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-ef94b652-9775-4c34-9611-b956dc8bdd62 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/aeb4c602-60dd-430e-927f-8b1d25fd960f" status: 404 len: 109 microversion: 2.1 time: 0.036458 Oct 24 13:19:59.543505 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 480/934] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 24 13:19:59 2022] GET /compute/v2.1/os-volumes/aeb4c602-60dd-430e-927f-8b1d25fd960f => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:19:59.547588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-a7a9acfa-b424-465b-82d7-4df9b2e40812 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Calling method '.version_select at 0x7fad286458b0>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:59.576681 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-a7a9acfa-b424-465b-82d7-4df9b2e40812 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] HTTP exception thrown: Volume aeb4c602-60dd-430e-927f-8b1d25fd960f could not be found. Oct 24 13:19:59.578635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-a7a9acfa-b424-465b-82d7-4df9b2e40812 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Request method failure captured: Oct 24 13:19:59.578635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: DELETE /compute/v2.1/os-volumes/aeb4c602-60dd-430e-927f-8b1d25fd960f HTTP/1.1 Oct 24 13:19:59.578635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:19:59.578635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:19:59.578635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:19:59.578635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:19:59.578635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:19:59.578635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:19:59.578635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:19:59.578635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:19:59.578635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVpD13ShzO2hZ9Kw8hMS7uqSkBP05a8q6JQsVOUjwh3w992Mr5gZa8k10mFYD3XHMCZhiXq5amyG_l08bs6p-6k-N-LKlh4pO_r6cGQh_Us3Js7_NPj5n3HURTjglvzDPa_WnDDiZDXh025ctRcZUNFEKfkR9dYPVYDAwYfLBX3Jxf8o Oct 24 13:19:59.578635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:19:59.578635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:19:59.578635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:19:59.578635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:19:59.578635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:19:59.578635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:19:59.578635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: 4edaa125c0154653b7b698cc42630b0d Oct 24 13:19:59.578635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1162507390 Oct 24 13:19:59.578635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:19:59.578635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:19:59.580246 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4edaa125c0154653b7b698cc42630b0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4edaa125c0154653b7b698cc42630b0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4edaa125c0154653b7b698cc42630b0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4edaa125c0154653b7b698cc42630b0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:19:59.580246 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1162507390 Oct 24 13:19:59.580246 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: 4edaa125c0154653b7b698cc42630b0d Oct 24 13:19:59.580246 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1162507390 Oct 24 13:19:59.580246 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-VolumesSnapshotsTestJSON-1162507390-project Oct 24 13:19:59.580246 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:19:59.580246 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:19:59.580246 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: abfbfe6583274bd88e90d7007a7c90a8 Oct 24 13:19:59.580246 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1162507390-project Oct 24 13:19:59.580246 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: Oct 24 13:19:59.580246 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Volume aeb4c602-60dd-430e-927f-8b1d25fd960f could not be found. Oct 24 13:19:59.580246 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': 'aeb4c602-60dd-430e-927f-8b1d25fd960f'} Oct 24 13:19:59.580246 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:59.581339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:59.581339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:19:59.581339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:19:59.581339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 13:19:59.581339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 13:19:59.581339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 13:19:59.581339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 13:19:59.581339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 13:19:59.581339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 13:19:59.581339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 13:19:59.581339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 13:19:59.581339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:19:59.581339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:19:59.581339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:19:59.581339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:19:59.581339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aeb4c602-60dd-430e-927f-8b1d25fd960f could not be found. (HTTP 404) (Request-ID: req-96c0db62-9e23-4a51-8061-934f9f98f07b) Oct 24 13:19:59.581339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:59.581339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:59.581339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:59.582885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:59.582885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 24 13:19:59.582885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 24 13:19:59.582885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:19:59.582885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:19:59.582885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 13:19:59.582885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 13:19:59.582885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:19:59.582885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:19:59.582885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:19:59.582885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:19:59.582885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 24 13:19:59.582885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 24 13:19:59.582885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 24 13:19:59.582885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 24 13:19:59.582885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 24 13:19:59.582885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 24 13:19:59.582885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 24 13:19:59.582885 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 24 13:19:59.584319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:19:59.584319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:19:59.584319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:19:59.584319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:19:59.584319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aeb4c602-60dd-430e-927f-8b1d25fd960f could not be found. Oct 24 13:19:59.584319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:59.584319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:59.584319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:59.584319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:59.584319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:59.584319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:59.584319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:59.584319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:59.584319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:19:59.584319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:19:59.584319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:59.584319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:59.584319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 24 13:19:59.584319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:59.585718 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aeb4c602-60dd-430e-927f-8b1d25fd960f could not be found. Oct 24 13:19:59.585718 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:59.585718 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:59.585718 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:59.585718 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:59.585718 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:59.585718 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:59.585718 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:59.585718 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:59.585718 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aeb4c602-60dd-430e-927f-8b1d25fd960f could not be found. Oct 24 13:19:59.585718 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:19:59.585718 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-a7a9acfa-b424-465b-82d7-4df9b2e40812 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Returning 404 to user: Volume aeb4c602-60dd-430e-927f-8b1d25fd960f could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:59.585718 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-a7a9acfa-b424-465b-82d7-4df9b2e40812 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/aeb4c602-60dd-430e-927f-8b1d25fd960f" status: 404 len: 109 microversion: 2.1 time: 0.036306 Oct 24 13:19:59.585718 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 455/935] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Oct 24 13:19:59 2022] DELETE /compute/v2.1/os-volumes/aeb4c602-60dd-430e-927f-8b1d25fd960f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:19:59.588428 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-5638ff1c-7ffa-4771-9eb3-5bc216e35215 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Calling method '.version_select at 0x7fad28421dc0>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:59.616328 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-5638ff1c-7ffa-4771-9eb3-5bc216e35215 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] HTTP exception thrown: Volume aeb4c602-60dd-430e-927f-8b1d25fd960f could not be found. Oct 24 13:19:59.618281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-5638ff1c-7ffa-4771-9eb3-5bc216e35215 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Request method failure captured: Oct 24 13:19:59.618281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: GET /compute/v2.1/os-volumes/aeb4c602-60dd-430e-927f-8b1d25fd960f HTTP/1.1 Oct 24 13:19:59.618281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:19:59.618281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:19:59.618281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:19:59.618281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:19:59.618281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:19:59.618281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:19:59.618281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:19:59.618281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:19:59.618281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVpD13ShzO2hZ9Kw8hMS7uqSkBP05a8q6JQsVOUjwh3w992Mr5gZa8k10mFYD3XHMCZhiXq5amyG_l08bs6p-6k-N-LKlh4pO_r6cGQh_Us3Js7_NPj5n3HURTjglvzDPa_WnDDiZDXh025ctRcZUNFEKfkR9dYPVYDAwYfLBX3Jxf8o Oct 24 13:19:59.618281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:19:59.618281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:19:59.618281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:19:59.618281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:19:59.618281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:19:59.618281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:19:59.618281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: 4edaa125c0154653b7b698cc42630b0d Oct 24 13:19:59.618281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1162507390 Oct 24 13:19:59.618281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:19:59.618281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:19:59.619893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4edaa125c0154653b7b698cc42630b0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4edaa125c0154653b7b698cc42630b0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4edaa125c0154653b7b698cc42630b0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4edaa125c0154653b7b698cc42630b0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:19:59.619893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1162507390 Oct 24 13:19:59.619893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: 4edaa125c0154653b7b698cc42630b0d Oct 24 13:19:59.619893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1162507390 Oct 24 13:19:59.619893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-VolumesSnapshotsTestJSON-1162507390-project Oct 24 13:19:59.619893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:19:59.619893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:19:59.619893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: abfbfe6583274bd88e90d7007a7c90a8 Oct 24 13:19:59.619893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1162507390-project Oct 24 13:19:59.619893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: Oct 24 13:19:59.619893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Volume aeb4c602-60dd-430e-927f-8b1d25fd960f could not be found. Oct 24 13:19:59.619893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': 'aeb4c602-60dd-430e-927f-8b1d25fd960f'} Oct 24 13:19:59.619893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:19:59.621024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:59.621024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:19:59.621024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:19:59.621024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:19:59.621024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:19:59.621024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:19:59.621024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:19:59.621024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:19:59.621024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:19:59.621024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:19:59.621024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:19:59.621024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:19:59.621024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:19:59.621024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:19:59.621024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:19:59.621024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aeb4c602-60dd-430e-927f-8b1d25fd960f could not be found. (HTTP 404) (Request-ID: req-f4089be0-069b-45fc-9aa4-31b7126ec431) Oct 24 13:19:59.621024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:59.621024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:59.621024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:59.622434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:59.622434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 13:19:59.622434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 13:19:59.622434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:19:59.622434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:19:59.622434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 13:19:59.622434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 13:19:59.622434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:19:59.622434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:19:59.622434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:19:59.622434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:19:59.622434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:19:59.622434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:19:59.622434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:19:59.622434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:19:59.622434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:19:59.622434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:19:59.622434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:19:59.622434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:19:59.623934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:19:59.623934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:19:59.623934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:19:59.623934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:19:59.623934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aeb4c602-60dd-430e-927f-8b1d25fd960f could not be found. Oct 24 13:19:59.623934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:59.623934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:59.623934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:59.623934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:59.623934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:59.623934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:59.623934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:19:59.623934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:19:59.623934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:19:59.623934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:19:59.623934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:19:59.623934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:19:59.623934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 13:19:59.623934 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:19:59.625354 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aeb4c602-60dd-430e-927f-8b1d25fd960f could not be found. Oct 24 13:19:59.625354 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:59.625354 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:19:59.625354 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:59.625354 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:19:59.625354 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:19:59.625354 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:19:59.625354 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:19:59.625354 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:19:59.625354 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aeb4c602-60dd-430e-927f-8b1d25fd960f could not be found. Oct 24 13:19:59.625354 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:19:59.625354 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-5638ff1c-7ffa-4771-9eb3-5bc216e35215 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] Returning 404 to user: Volume aeb4c602-60dd-430e-927f-8b1d25fd960f could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:19:59.625354 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-5638ff1c-7ffa-4771-9eb3-5bc216e35215 tempest-VolumesSnapshotsTestJSON-1162507390 tempest-VolumesSnapshotsTestJSON-1162507390-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/aeb4c602-60dd-430e-927f-8b1d25fd960f" status: 404 len: 109 microversion: 2.1 time: 0.035021 Oct 24 13:19:59.625354 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 481/936] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 24 13:19:59 2022] GET /compute/v2.1/os-volumes/aeb4c602-60dd-430e-927f-8b1d25fd960f => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:19:59.662074 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-62db3ad4-284a-4776-8917-068690ec240c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:19:59.662679 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-62db3ad4-284a-4776-8917-068690ec240c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:19:59.671742 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-62db3ad4-284a-4776-8917-068690ec240c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:59.672223 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-62db3ad4-284a-4776-8917-068690ec240c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:59.672661 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-62db3ad4-284a-4776-8917-068690ec240c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:59.673352 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-62db3ad4-284a-4776-8917-068690ec240c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:19:59.673807 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-62db3ad4-284a-4776-8917-068690ec240c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:19:59.674234 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-62db3ad4-284a-4776-8917-068690ec240c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:19:59.823337 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-62db3ad4-284a-4776-8917-068690ec240c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:19:59.829100 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-62db3ad4-284a-4776-8917-068690ec240c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1260 microversion: 2.1 time: 0.171326 Oct 24 13:19:59.829673 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 456/937] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:19:59 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:20:00.853358 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-20e0cd08-4d1d-4f99-9611-258e9aca34f9 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:20:00.854222 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-20e0cd08-4d1d-4f99-9611-258e9aca34f9 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:20:00.856269 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:00.866782 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-20e0cd08-4d1d-4f99-9611-258e9aca34f9 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:20:00.868163 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-20e0cd08-4d1d-4f99-9611-258e9aca34f9 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:20:00.869010 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-20e0cd08-4d1d-4f99-9611-258e9aca34f9 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:20:00.870307 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-20e0cd08-4d1d-4f99-9611-258e9aca34f9 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:20:00.871238 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-20e0cd08-4d1d-4f99-9611-258e9aca34f9 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:20:00.871930 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-20e0cd08-4d1d-4f99-9611-258e9aca34f9 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:20:01.033116 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-20e0cd08-4d1d-4f99-9611-258e9aca34f9 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:20:01.045191 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-20e0cd08-4d1d-4f99-9611-258e9aca34f9 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1260 microversion: 2.1 time: 0.196578 Oct 24 13:20:01.046312 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 482/938] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:20:00 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:20:01.288598 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-3d3d80df-2f23-4d2b-8007-6d4e91914f8f tempest-VolumesGetTestJSON-1169645266 tempest-VolumesGetTestJSON-1169645266-project] Action: 'create', calling method: .version_select at 0x7fad28645f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-124027049", "metadata": {"Type": "work"}}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:20:01.640286 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-3d3d80df-2f23-4d2b-8007-6d4e91914f8f tempest-VolumesGetTestJSON-1169645266 tempest-VolumesGetTestJSON-1169645266-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.473251 Oct 24 13:20:01.640910 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 457/939] 10.222.0.42 () {60 vars in 1156 bytes} [Mon Oct 24 13:20:01 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 475 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 24 13:20:01.657336 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-12a091d0-cca5-4a70-be67-adf37d467e09 tempest-VolumesGetTestJSON-1169645266 tempest-VolumesGetTestJSON-1169645266-project] Calling method '.version_select at 0x7fad2841c430>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:20:01.709181 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-12a091d0-cca5-4a70-be67-adf37d467e09 tempest-VolumesGetTestJSON-1169645266 tempest-VolumesGetTestJSON-1169645266-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/01be18d9-568b-412c-ad1d-c6f7f6a4bbb8" status: 200 len: 352 microversion: 2.1 time: 0.058862 Oct 24 13:20:01.709940 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 483/940] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 24 13:20:01 2022] GET /compute/v2.1/os-volumes/01be18d9-568b-412c-ad1d-c6f7f6a4bbb8 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:20:02.072368 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-aa19d730-7abe-4426-b89b-8fc96f6d7b20 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:20:02.072982 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-aa19d730-7abe-4426-b89b-8fc96f6d7b20 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:20:02.079941 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aa19d730-7abe-4426-b89b-8fc96f6d7b20 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:20:02.080435 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aa19d730-7abe-4426-b89b-8fc96f6d7b20 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:20:02.080871 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aa19d730-7abe-4426-b89b-8fc96f6d7b20 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:20:02.081576 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aa19d730-7abe-4426-b89b-8fc96f6d7b20 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:20:02.082033 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aa19d730-7abe-4426-b89b-8fc96f6d7b20 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:20:02.082451 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aa19d730-7abe-4426-b89b-8fc96f6d7b20 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:20:02.277671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-aa19d730-7abe-4426-b89b-8fc96f6d7b20 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:20:02.286824 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-aa19d730-7abe-4426-b89b-8fc96f6d7b20 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1260 microversion: 2.1 time: 0.218311 Oct 24 13:20:02.287780 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 458/941] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:20:02 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:20:02.728419 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c07fa262-4d47-4ed5-a356-56e9efbe239b tempest-VolumesGetTestJSON-1169645266 tempest-VolumesGetTestJSON-1169645266-project] Calling method '.version_select at 0x7fad283689d0>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:20:02.786177 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-c07fa262-4d47-4ed5-a356-56e9efbe239b tempest-VolumesGetTestJSON-1169645266 tempest-VolumesGetTestJSON-1169645266-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/01be18d9-568b-412c-ad1d-c6f7f6a4bbb8" status: 200 len: 353 microversion: 2.1 time: 0.062415 Oct 24 13:20:02.787307 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 484/942] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 24 13:20:02 2022] GET /compute/v2.1/os-volumes/01be18d9-568b-412c-ad1d-c6f7f6a4bbb8 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:20:02.801424 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-919c8c18-6e98-4ca2-8788-dd8ff14ee875 tempest-VolumesGetTestJSON-1169645266 tempest-VolumesGetTestJSON-1169645266-project] Calling method '.version_select at 0x7fad285144c0>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:20:02.824965 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-b2b682a9-e617-424a-a144-33235779e0cb req-7f6ddf3f-fd0c-4c4b-8349-60e207a09949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8", "name": "network-vif-plugged", "status": "completed", "tag": "7ee73beb-73a9-4d41-969d-8ee93d5f0945"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:20:02.841484 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-b2b682a9-e617-424a-a144-33235779e0cb req-7f6ddf3f-fd0c-4c4b-8349-60e207a09949 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:20:02.842406 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-b2b682a9-e617-424a-a144-33235779e0cb req-7f6ddf3f-fd0c-4c4b-8349-60e207a09949 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:20:02.843401 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-b2b682a9-e617-424a-a144-33235779e0cb req-7f6ddf3f-fd0c-4c4b-8349-60e207a09949 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:20:02.856506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-b2b682a9-e617-424a-a144-33235779e0cb req-7f6ddf3f-fd0c-4c4b-8349-60e207a09949 service nova] Creating event network-vif-plugged:7ee73beb-73a9-4d41-969d-8ee93d5f0945 for instance 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 on hv-cinder-86248 Oct 24 13:20:02.863764 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-b2b682a9-e617-424a-a144-33235779e0cb req-7f6ddf3f-fd0c-4c4b-8349-60e207a09949 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056321 Oct 24 13:20:02.865179 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 485/943] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:20:02.871526 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-919c8c18-6e98-4ca2-8788-dd8ff14ee875 tempest-VolumesGetTestJSON-1169645266 tempest-VolumesGetTestJSON-1169645266-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/01be18d9-568b-412c-ad1d-c6f7f6a4bbb8" status: 200 len: 353 microversion: 2.1 time: 0.074944 Oct 24 13:20:02.872339 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 459/944] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 24 13:20:02 2022] GET /compute/v2.1/os-volumes/01be18d9-568b-412c-ad1d-c6f7f6a4bbb8 => generated 353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:20:02.891095 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-27f98579-2a05-405b-a8de-bfa267aa6831 tempest-VolumesGetTestJSON-1169645266 tempest-VolumesGetTestJSON-1169645266-project] Calling method '.version_select at 0x7fad283680d0>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:20:02.963520 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-27f98579-2a05-405b-a8de-bfa267aa6831 tempest-VolumesGetTestJSON-1169645266 tempest-VolumesGetTestJSON-1169645266-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/01be18d9-568b-412c-ad1d-c6f7f6a4bbb8" status: 202 len: 0 microversion: 2.1 time: 0.076553 Oct 24 13:20:02.964094 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 486/945] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Oct 24 13:20:02 2022] DELETE /compute/v2.1/os-volumes/01be18d9-568b-412c-ad1d-c6f7f6a4bbb8 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:20:02.973717 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-0af22667-d9f0-4780-92b7-c9a6391ac370 tempest-VolumesGetTestJSON-1169645266 tempest-VolumesGetTestJSON-1169645266-project] Calling method '.version_select at 0x7fad28903ca0>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:20:03.042380 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-0af22667-d9f0-4780-92b7-c9a6391ac370 tempest-VolumesGetTestJSON-1169645266 tempest-VolumesGetTestJSON-1169645266-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/01be18d9-568b-412c-ad1d-c6f7f6a4bbb8" status: 200 len: 352 microversion: 2.1 time: 0.073967 Oct 24 13:20:03.042952 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 460/946] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 24 13:20:02 2022] GET /compute/v2.1/os-volumes/01be18d9-568b-412c-ad1d-c6f7f6a4bbb8 => generated 352 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:20:03.309785 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-6f8c8aa5-16d6-4b38-a799-13416be22261 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:20:03.310506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-6f8c8aa5-16d6-4b38-a799-13416be22261 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:20:03.318125 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6f8c8aa5-16d6-4b38-a799-13416be22261 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:20:03.318606 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6f8c8aa5-16d6-4b38-a799-13416be22261 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:20:03.319035 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6f8c8aa5-16d6-4b38-a799-13416be22261 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:20:03.319869 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6f8c8aa5-16d6-4b38-a799-13416be22261 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:20:03.320766 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6f8c8aa5-16d6-4b38-a799-13416be22261 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:20:03.321354 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6f8c8aa5-16d6-4b38-a799-13416be22261 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:20:03.468666 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-6f8c8aa5-16d6-4b38-a799-13416be22261 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:20:03.478111 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-6f8c8aa5-16d6-4b38-a799-13416be22261 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1260 microversion: 2.1 time: 0.172144 Oct 24 13:20:03.478690 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 487/947] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:20:03 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:20:04.058454 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-2b1feee9-31ae-4369-91e3-b623c1cb7473 tempest-VolumesGetTestJSON-1169645266 tempest-VolumesGetTestJSON-1169645266-project] Calling method '.version_select at 0x7fad284d8e50>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:20:04.090544 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-2b1feee9-31ae-4369-91e3-b623c1cb7473 tempest-VolumesGetTestJSON-1169645266 tempest-VolumesGetTestJSON-1169645266-project] HTTP exception thrown: Volume 01be18d9-568b-412c-ad1d-c6f7f6a4bbb8 could not be found. Oct 24 13:20:04.093056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-2b1feee9-31ae-4369-91e3-b623c1cb7473 tempest-VolumesGetTestJSON-1169645266 tempest-VolumesGetTestJSON-1169645266-project] Request method failure captured: Oct 24 13:20:04.093056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: GET /compute/v2.1/os-volumes/01be18d9-568b-412c-ad1d-c6f7f6a4bbb8 HTTP/1.1 Oct 24 13:20:04.093056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:20:04.093056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:20:04.093056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:20:04.093056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:20:04.093056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:20:04.093056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:20:04.093056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:20:04.093056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:20:04.093056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVpEBnnI401actcZRqli8rW_rn7kFQS0NPqdQB6drKDX8fs-Sa2L_qy2XkXo09d-RqkSwbG552pS2IatEr84WX9UxallsX3EnRGetZlPEzbkLix9G-ZnWpGsoBLOha4UyungHRFeGbgeKcGwuxK717yiH6D-T7yamyJoePML79CX4-y0 Oct 24 13:20:04.093056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:20:04.093056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:20:04.093056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:20:04.093056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:20:04.093056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:20:04.093056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:20:04.093056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: 5a26e1adc98e44a6b744493552d8319f Oct 24 13:20:04.093056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-VolumesGetTestJSON-1169645266 Oct 24 13:20:04.093056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:20:04.093056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:20:04.094860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5a26e1adc98e44a6b744493552d8319f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5a26e1adc98e44a6b744493552d8319f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5a26e1adc98e44a6b744493552d8319f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5a26e1adc98e44a6b744493552d8319f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:20:04.094860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-VolumesGetTestJSON-1169645266 Oct 24 13:20:04.094860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: 5a26e1adc98e44a6b744493552d8319f Oct 24 13:20:04.094860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-VolumesGetTestJSON-1169645266 Oct 24 13:20:04.094860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-VolumesGetTestJSON-1169645266-project Oct 24 13:20:04.094860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:20:04.094860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:20:04.094860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: a7d72a421d8f49d1bfaa7946c961eefa Oct 24 13:20:04.094860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-VolumesGetTestJSON-1169645266-project Oct 24 13:20:04.094860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: Oct 24 13:20:04.094860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Volume 01be18d9-568b-412c-ad1d-c6f7f6a4bbb8 could not be found. Oct 24 13:20:04.094860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': '01be18d9-568b-412c-ad1d-c6f7f6a4bbb8'} Oct 24 13:20:04.094860 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:20:04.095931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:20:04.095931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:20:04.095931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:20:04.095931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:20:04.095931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:20:04.095931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:20:04.095931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:20:04.095931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:20:04.095931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:20:04.095931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:20:04.095931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:20:04.095931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:20:04.095931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:20:04.095931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:20:04.095931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:20:04.095931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 01be18d9-568b-412c-ad1d-c6f7f6a4bbb8 could not be found. (HTTP 404) (Request-ID: req-8dd67cd9-7bca-4b3c-b32f-957005014414) Oct 24 13:20:04.095931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:20:04.095931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:20:04.095931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:20:04.097507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:20:04.097507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 24 13:20:04.097507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 24 13:20:04.097507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 24 13:20:04.097507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 24 13:20:04.097507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 24 13:20:04.097507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 24 13:20:04.097507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 24 13:20:04.097507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 24 13:20:04.097507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 24 13:20:04.097507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 24 13:20:04.097507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 24 13:20:04.097507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 24 13:20:04.097507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 24 13:20:04.097507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 24 13:20:04.097507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 24 13:20:04.097507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 24 13:20:04.097507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 24 13:20:04.097507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 24 13:20:04.098786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 24 13:20:04.098786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 24 13:20:04.098786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 24 13:20:04.098786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 24 13:20:04.098786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 01be18d9-568b-412c-ad1d-c6f7f6a4bbb8 could not be found. Oct 24 13:20:04.098786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:20:04.098786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:20:04.098786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:20:04.098786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:20:04.098786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:20:04.098786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:20:04.098786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:20:04.098786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:20:04.098786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 24 13:20:04.098786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 24 13:20:04.098786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:20:04.098786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:20:04.098786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 24 13:20:04.098786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:20:04.100037 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 01be18d9-568b-412c-ad1d-c6f7f6a4bbb8 could not be found. Oct 24 13:20:04.100037 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:20:04.100037 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:20:04.100037 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:20:04.100037 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:20:04.100037 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:20:04.100037 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:20:04.100037 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:20:04.100037 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:20:04.100037 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 01be18d9-568b-412c-ad1d-c6f7f6a4bbb8 could not be found. Oct 24 13:20:04.100037 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:20:04.100037 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-2b1feee9-31ae-4369-91e3-b623c1cb7473 tempest-VolumesGetTestJSON-1169645266 tempest-VolumesGetTestJSON-1169645266-project] Returning 404 to user: Volume 01be18d9-568b-412c-ad1d-c6f7f6a4bbb8 could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:20:04.100037 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-2b1feee9-31ae-4369-91e3-b623c1cb7473 tempest-VolumesGetTestJSON-1169645266 tempest-VolumesGetTestJSON-1169645266-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/01be18d9-568b-412c-ad1d-c6f7f6a4bbb8" status: 404 len: 109 microversion: 2.1 time: 0.041690 Oct 24 13:20:04.100037 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 461/948] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Oct 24 13:20:04 2022] GET /compute/v2.1/os-volumes/01be18d9-568b-412c-ad1d-c6f7f6a4bbb8 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:20:04.502284 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-550a2f33-2a86-44e8-b658-bd700fea3d61 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:20:04.503162 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-550a2f33-2a86-44e8-b658-bd700fea3d61 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:20:04.519530 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-550a2f33-2a86-44e8-b658-bd700fea3d61 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:20:04.520050 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-550a2f33-2a86-44e8-b658-bd700fea3d61 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:20:04.520485 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-550a2f33-2a86-44e8-b658-bd700fea3d61 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:20:04.521183 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-550a2f33-2a86-44e8-b658-bd700fea3d61 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:20:04.521670 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-550a2f33-2a86-44e8-b658-bd700fea3d61 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:20:04.522321 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-550a2f33-2a86-44e8-b658-bd700fea3d61 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:20:04.686763 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-550a2f33-2a86-44e8-b658-bd700fea3d61 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:20:04.696390 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-550a2f33-2a86-44e8-b658-bd700fea3d61 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1260 microversion: 2.1 time: 0.199151 Oct 24 13:20:04.697470 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 488/949] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:20:04 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1260 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:20:05.720576 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-2c6b9d98-b8de-471c-b3e7-1273c048132a tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:20:05.721878 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-2c6b9d98-b8de-471c-b3e7-1273c048132a tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:20:05.727932 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c6b9d98-b8de-471c-b3e7-1273c048132a tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:20:05.728412 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c6b9d98-b8de-471c-b3e7-1273c048132a tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:20:05.728874 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c6b9d98-b8de-471c-b3e7-1273c048132a tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:20:05.729555 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c6b9d98-b8de-471c-b3e7-1273c048132a tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:20:05.730058 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c6b9d98-b8de-471c-b3e7-1273c048132a tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:20:05.730421 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c6b9d98-b8de-471c-b3e7-1273c048132a tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:20:05.903876 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-2c6b9d98-b8de-471c-b3e7-1273c048132a tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:20:05.911722 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-2c6b9d98-b8de-471c-b3e7-1273c048132a tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1444 microversion: 2.1 time: 0.195463 Oct 24 13:20:05.912286 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 462/950] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:20:05 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1444 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:20:05.936363 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a4d261aa-7a95-4d51-942a-b794f222eec2 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:20:05.937390 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a4d261aa-7a95-4d51-942a-b794f222eec2 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:20:05.947483 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4d261aa-7a95-4d51-942a-b794f222eec2 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:20:05.948255 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4d261aa-7a95-4d51-942a-b794f222eec2 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:20:05.949049 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4d261aa-7a95-4d51-942a-b794f222eec2 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:20:05.950034 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4d261aa-7a95-4d51-942a-b794f222eec2 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:20:05.950777 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4d261aa-7a95-4d51-942a-b794f222eec2 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:20:05.951514 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a4d261aa-7a95-4d51-942a-b794f222eec2 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:20:06.139369 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a4d261aa-7a95-4d51-942a-b794f222eec2 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:20:06.148505 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a4d261aa-7a95-4d51-942a-b794f222eec2 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1444 microversion: 2.1 time: 0.216803 Oct 24 13:20:06.149368 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 489/951] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:20:05 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1444 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:20:08.436765 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-c28ad026-f83e-40be-83de-b8743c7dcb92 req-30806f48-e805-4fa7-a7cb-f3d5aec5fe7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8", "tag": "7ee73beb-73a9-4d41-969d-8ee93d5f0945"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:20:08.446156 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:08.448761 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-c28ad026-f83e-40be-83de-b8743c7dcb92 req-30806f48-e805-4fa7-a7cb-f3d5aec5fe7e service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:20:08.450138 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-c28ad026-f83e-40be-83de-b8743c7dcb92 req-30806f48-e805-4fa7-a7cb-f3d5aec5fe7e service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:20:08.450641 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-c28ad026-f83e-40be-83de-b8743c7dcb92 req-30806f48-e805-4fa7-a7cb-f3d5aec5fe7e service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:20:08.469459 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-c28ad026-f83e-40be-83de-b8743c7dcb92 req-30806f48-e805-4fa7-a7cb-f3d5aec5fe7e service nova] Creating event network-changed:7ee73beb-73a9-4d41-969d-8ee93d5f0945 for instance 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 on hv-cinder-86248 Oct 24 13:20:08.476067 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-c28ad026-f83e-40be-83de-b8743c7dcb92 req-30806f48-e805-4fa7-a7cb-f3d5aec5fe7e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043290 Oct 24 13:20:08.478124 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 463/952] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:20:39.501497 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=9 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:39.502540 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=37 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:20:39.770171 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-8fccbea3-2d29-4ed3-85ba-aded7ae1535a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Action: 'create', calling method: .version_select at 0x7fad28613790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1788078914", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkr6t8jeW7sQ2mDFvYrKzBP1sfgX6+XbTIDPBvYuSDv3T2BtGVMpLMhrmKzqype0QtAubpx97rsxpcyrcSCM2hswrK6O3cabwAQyfkFtxP+GgtKUzqmixau5IshAZ5GmQ=="}} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:20:39.805459 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-8fccbea3-2d29-4ed3-85ba-aded7ae1535a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Getting quotas for project e5f4729aa5f44fe08096bed3438e8f7e. Resources: {'key_pairs'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:20:39.809937 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.quota [None req-8fccbea3-2d29-4ed3-85ba-aded7ae1535a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Getting quotas for user 1fe85edb1188403d84072d19128e07d5 and project e5f4729aa5f44fe08096bed3438e8f7e. Resources: {'key_pairs'} {{(pid=118914) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:20:39.839552 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-8fccbea3-2d29-4ed3-85ba-aded7ae1535a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.342788 Oct 24 13:20:39.840140 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 490/953] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Oct 24 13:20:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:21:00.534119 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=33 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:21:00.534946 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:SELECT=1 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:21:00.539400 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-6edb483d-dde1-44d4-bd1d-cf50171bc204 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-573876383", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1788078914", "security_groups": [{"name": "tempest-secgroup-smoke-217361373"}], "block_device_mapping_v2": [{"uuid": "b743f732-9f16-4a46-9696-52debaf4f7ab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d81e8b5b-f582-42f2-8207-457fa8977c00"}]}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:21:00.653307 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.network.neutron [None req-6edb483d-dde1-44d4-bd1d-cf50171bc204 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] validate_networks() for [('d81e8b5b-f582-42f2-8207-457fa8977c00', None, None, None, None, None)] {{(pid=118915) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:21:01.255836 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-6edb483d-dde1-44d4-bd1d-cf50171bc204 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Flavor limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:21:01.256258 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-6edb483d-dde1-44d4-bd1d-cf50171bc204 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Image limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:21:01.256734 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-6edb483d-dde1-44d4-bd1d-cf50171bc204 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Flavor pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:21:01.257178 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-6edb483d-dde1-44d4-bd1d-cf50171bc204 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Image pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:21:01.257591 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-6edb483d-dde1-44d4-bd1d-cf50171bc204 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:21:01.266480 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6edb483d-dde1-44d4-bd1d-cf50171bc204 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:01.266962 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6edb483d-dde1-44d4-bd1d-cf50171bc204 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:01.267431 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6edb483d-dde1-44d4-bd1d-cf50171bc204 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:01.268293 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6edb483d-dde1-44d4-bd1d-cf50171bc204 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:01.268750 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6edb483d-dde1-44d4-bd1d-cf50171bc204 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:01.269177 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6edb483d-dde1-44d4-bd1d-cf50171bc204 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:01.286039 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-6edb483d-dde1-44d4-bd1d-cf50171bc204 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Getting quotas for project e5f4729aa5f44fe08096bed3438e8f7e. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:21:01.289981 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-6edb483d-dde1-44d4-bd1d-cf50171bc204 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Getting quotas for user 1fe85edb1188403d84072d19128e07d5 and project e5f4729aa5f44fe08096bed3438e8f7e. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:21:01.345260 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-6edb483d-dde1-44d4-bd1d-cf50171bc204 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Going to run 1 instances... {{(pid=118915) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:21:01.348104 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-6edb483d-dde1-44d4-bd1d-cf50171bc204 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b743f732-9f16-4a46-9696-52debaf4f7ab',volume_size=None,volume_type=None)] {{(pid=118915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:21:01.478564 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-6edb483d-dde1-44d4-bd1d-cf50171bc204 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.946310 Oct 24 13:21:01.479323 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 464/954] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 24 13:21:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:21:01.488538 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=4 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:21:01.489277 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:21:01.494774 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-3f8595b0-e8ae-4cbe-942c-f2f80de828a7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:01.495761 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-3f8595b0-e8ae-4cbe-942c-f2f80de828a7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:01.551676 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-3f8595b0-e8ae-4cbe-942c-f2f80de828a7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:01.558460 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-3f8595b0-e8ae-4cbe-942c-f2f80de828a7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334" status: 200 len: 1094 microversion: 2.1 time: 0.071972 Oct 24 13:21:01.559046 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 491/955] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:01 2022] GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:02.581640 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-63b43281-8c80-4e4d-aab5-ab4bb9102493 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:02.583096 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-63b43281-8c80-4e4d-aab5-ab4bb9102493 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:02.591137 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-63b43281-8c80-4e4d-aab5-ab4bb9102493 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:02.591626 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-63b43281-8c80-4e4d-aab5-ab4bb9102493 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:02.592059 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-63b43281-8c80-4e4d-aab5-ab4bb9102493 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:02.592783 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-63b43281-8c80-4e4d-aab5-ab4bb9102493 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:02.593234 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-63b43281-8c80-4e4d-aab5-ab4bb9102493 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:02.593653 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-63b43281-8c80-4e4d-aab5-ab4bb9102493 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:02.668579 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-63b43281-8c80-4e4d-aab5-ab4bb9102493 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:02.677225 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-63b43281-8c80-4e4d-aab5-ab4bb9102493 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334" status: 200 len: 1210 microversion: 2.1 time: 0.100166 Oct 24 13:21:02.678166 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 465/956] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:02 2022] GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 => generated 1210 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:03.701507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-3c3819fc-bd13-499b-990f-35ff212ad4c7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:03.702888 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-3c3819fc-bd13-499b-990f-35ff212ad4c7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:03.713067 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3c3819fc-bd13-499b-990f-35ff212ad4c7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:03.713550 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3c3819fc-bd13-499b-990f-35ff212ad4c7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:03.713979 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3c3819fc-bd13-499b-990f-35ff212ad4c7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:03.714665 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3c3819fc-bd13-499b-990f-35ff212ad4c7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:03.715251 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3c3819fc-bd13-499b-990f-35ff212ad4c7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:03.715682 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3c3819fc-bd13-499b-990f-35ff212ad4c7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:03.853449 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-3c3819fc-bd13-499b-990f-35ff212ad4c7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:03.862628 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-3c3819fc-bd13-499b-990f-35ff212ad4c7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334" status: 200 len: 1265 microversion: 2.1 time: 0.164043 Oct 24 13:21:03.863421 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 492/957] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:03 2022] GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:03.925162 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-13019a42-f501-4369-a95a-a1f489cb3f1a req-499a1403-9c7d-4a1c-af00-a874d2b25bea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "540ac816-895b-4737-8d42-9b2c7817f334", "tag": "6d9a9a89-0d40-45ae-b4f3-42bb1681566f"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:21:03.933105 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 13:21:03.933269 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Mon Oct 24 13:21:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Oct 24 13:21:03.950262 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-13019a42-f501-4369-a95a-a1f489cb3f1a req-499a1403-9c7d-4a1c-af00-a874d2b25bea service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:03.950767 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-13019a42-f501-4369-a95a-a1f489cb3f1a req-499a1403-9c7d-4a1c-af00-a874d2b25bea service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:03.951441 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-13019a42-f501-4369-a95a-a1f489cb3f1a req-499a1403-9c7d-4a1c-af00-a874d2b25bea service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:03.962783 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-13019a42-f501-4369-a95a-a1f489cb3f1a req-499a1403-9c7d-4a1c-af00-a874d2b25bea service nova] Creating event network-changed:6d9a9a89-0d40-45ae-b4f3-42bb1681566f for instance 540ac816-895b-4737-8d42-9b2c7817f334 on hv-cinder-86248 Oct 24 13:21:03.968680 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-13019a42-f501-4369-a95a-a1f489cb3f1a req-499a1403-9c7d-4a1c-af00-a874d2b25bea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046670 Oct 24 13:21:03.969120 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 466/958] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:21:04.886232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-50ce83ff-30a3-4bfd-9e9f-f7d3dd5b3f3d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:04.886932 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-50ce83ff-30a3-4bfd-9e9f-f7d3dd5b3f3d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:04.894242 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-50ce83ff-30a3-4bfd-9e9f-f7d3dd5b3f3d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:04.894733 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-50ce83ff-30a3-4bfd-9e9f-f7d3dd5b3f3d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:04.895238 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-50ce83ff-30a3-4bfd-9e9f-f7d3dd5b3f3d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:04.895946 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-50ce83ff-30a3-4bfd-9e9f-f7d3dd5b3f3d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:04.896406 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-50ce83ff-30a3-4bfd-9e9f-f7d3dd5b3f3d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:04.896833 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-50ce83ff-30a3-4bfd-9e9f-f7d3dd5b3f3d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:05.027742 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-50ce83ff-30a3-4bfd-9e9f-f7d3dd5b3f3d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:05.036073 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-50ce83ff-30a3-4bfd-9e9f-f7d3dd5b3f3d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334" status: 200 len: 1265 microversion: 2.1 time: 0.153910 Oct 24 13:21:05.036687 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 493/959] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:04 2022] GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:21:06.058316 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-05935036-2542-46b0-9169-7f4bfaf707a2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:06.059183 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-05935036-2542-46b0-9169-7f4bfaf707a2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:06.079435 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-05935036-2542-46b0-9169-7f4bfaf707a2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:06.079931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-05935036-2542-46b0-9169-7f4bfaf707a2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:06.080466 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-05935036-2542-46b0-9169-7f4bfaf707a2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:06.081184 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-05935036-2542-46b0-9169-7f4bfaf707a2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:06.081635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-05935036-2542-46b0-9169-7f4bfaf707a2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:06.082060 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-05935036-2542-46b0-9169-7f4bfaf707a2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:06.261750 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-05935036-2542-46b0-9169-7f4bfaf707a2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:06.270509 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-05935036-2542-46b0-9169-7f4bfaf707a2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334" status: 200 len: 1265 microversion: 2.1 time: 0.216352 Oct 24 13:21:06.270967 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 467/960] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:06 2022] GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:07.294119 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-06ead8a6-a073-427a-9fa4-303eaa3da395 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:07.294775 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-06ead8a6-a073-427a-9fa4-303eaa3da395 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:07.302029 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-06ead8a6-a073-427a-9fa4-303eaa3da395 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:07.302551 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-06ead8a6-a073-427a-9fa4-303eaa3da395 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:07.302982 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-06ead8a6-a073-427a-9fa4-303eaa3da395 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:07.303731 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-06ead8a6-a073-427a-9fa4-303eaa3da395 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:07.304234 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-06ead8a6-a073-427a-9fa4-303eaa3da395 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:07.304656 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-06ead8a6-a073-427a-9fa4-303eaa3da395 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:07.438791 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-06ead8a6-a073-427a-9fa4-303eaa3da395 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:07.447191 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-06ead8a6-a073-427a-9fa4-303eaa3da395 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334" status: 200 len: 1265 microversion: 2.1 time: 0.157001 Oct 24 13:21:07.447768 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 494/961] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:07 2022] GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:08.471655 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-6ab65a91-ebbc-4891-aeea-d0c4a7da10db tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:08.472507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-6ab65a91-ebbc-4891-aeea-d0c4a7da10db tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:08.478294 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6ab65a91-ebbc-4891-aeea-d0c4a7da10db tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:08.478772 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6ab65a91-ebbc-4891-aeea-d0c4a7da10db tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:08.479239 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6ab65a91-ebbc-4891-aeea-d0c4a7da10db tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:08.479918 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6ab65a91-ebbc-4891-aeea-d0c4a7da10db tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:08.480368 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6ab65a91-ebbc-4891-aeea-d0c4a7da10db tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:08.480785 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6ab65a91-ebbc-4891-aeea-d0c4a7da10db tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:08.613639 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-6ab65a91-ebbc-4891-aeea-d0c4a7da10db tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:08.622013 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-6ab65a91-ebbc-4891-aeea-d0c4a7da10db tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334" status: 200 len: 1265 microversion: 2.1 time: 0.154549 Oct 24 13:21:08.622579 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 468/962] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:08 2022] GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:09.646235 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c37850d9-1901-4d83-88da-b36f8feed567 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:09.647234 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-c37850d9-1901-4d83-88da-b36f8feed567 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:09.653531 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c37850d9-1901-4d83-88da-b36f8feed567 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:09.654009 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c37850d9-1901-4d83-88da-b36f8feed567 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:09.654445 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c37850d9-1901-4d83-88da-b36f8feed567 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:09.655151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c37850d9-1901-4d83-88da-b36f8feed567 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:09.655603 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c37850d9-1901-4d83-88da-b36f8feed567 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:09.656020 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c37850d9-1901-4d83-88da-b36f8feed567 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:09.789695 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-c37850d9-1901-4d83-88da-b36f8feed567 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:09.797576 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-c37850d9-1901-4d83-88da-b36f8feed567 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334" status: 200 len: 1265 microversion: 2.1 time: 0.155781 Oct 24 13:21:09.798136 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 495/963] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:09 2022] GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:10.822653 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-55918ff2-6dd6-46f3-81cb-efe0e5ed3d5c tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:10.823224 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-55918ff2-6dd6-46f3-81cb-efe0e5ed3d5c tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:10.829757 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-55918ff2-6dd6-46f3-81cb-efe0e5ed3d5c tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:10.830237 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-55918ff2-6dd6-46f3-81cb-efe0e5ed3d5c tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:10.830663 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-55918ff2-6dd6-46f3-81cb-efe0e5ed3d5c tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:10.832039 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-55918ff2-6dd6-46f3-81cb-efe0e5ed3d5c tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:10.832508 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-55918ff2-6dd6-46f3-81cb-efe0e5ed3d5c tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:10.832928 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-55918ff2-6dd6-46f3-81cb-efe0e5ed3d5c tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:10.963859 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-55918ff2-6dd6-46f3-81cb-efe0e5ed3d5c tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:10.971463 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-55918ff2-6dd6-46f3-81cb-efe0e5ed3d5c tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334" status: 200 len: 1265 microversion: 2.1 time: 0.153584 Oct 24 13:21:10.972155 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 469/964] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:10 2022] GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:11.994177 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d967d165-e57e-4ac3-9401-9a586524fdf2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:11.994788 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-d967d165-e57e-4ac3-9401-9a586524fdf2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:11.997141 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=2 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:21:12.002398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d967d165-e57e-4ac3-9401-9a586524fdf2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:12.003439 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d967d165-e57e-4ac3-9401-9a586524fdf2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:12.004040 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d967d165-e57e-4ac3-9401-9a586524fdf2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:12.004661 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d967d165-e57e-4ac3-9401-9a586524fdf2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:12.005119 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d967d165-e57e-4ac3-9401-9a586524fdf2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:12.005540 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d967d165-e57e-4ac3-9401-9a586524fdf2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:12.141131 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-d967d165-e57e-4ac3-9401-9a586524fdf2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:12.150944 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-d967d165-e57e-4ac3-9401-9a586524fdf2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334" status: 200 len: 1265 microversion: 2.1 time: 0.160692 Oct 24 13:21:12.151535 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 496/965] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:11 2022] GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:13.175215 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-602c05d1-8c34-4a79-8a66-dd50d4f3f3e4 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:13.176561 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-602c05d1-8c34-4a79-8a66-dd50d4f3f3e4 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:13.179343 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=2 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:21:13.180410 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=6 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:21:13.188589 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-602c05d1-8c34-4a79-8a66-dd50d4f3f3e4 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:13.189086 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-602c05d1-8c34-4a79-8a66-dd50d4f3f3e4 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:13.189516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-602c05d1-8c34-4a79-8a66-dd50d4f3f3e4 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:13.190209 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-602c05d1-8c34-4a79-8a66-dd50d4f3f3e4 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:13.191852 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-602c05d1-8c34-4a79-8a66-dd50d4f3f3e4 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:13.192595 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-602c05d1-8c34-4a79-8a66-dd50d4f3f3e4 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:13.323675 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-602c05d1-8c34-4a79-8a66-dd50d4f3f3e4 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:13.331729 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-602c05d1-8c34-4a79-8a66-dd50d4f3f3e4 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334" status: 200 len: 1265 microversion: 2.1 time: 0.160971 Oct 24 13:21:13.332417 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 470/966] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:13 2022] GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:14.354364 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c8443514-a21f-4b74-90fd-f7183df297ed tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:14.354980 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-c8443514-a21f-4b74-90fd-f7183df297ed tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:14.361283 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c8443514-a21f-4b74-90fd-f7183df297ed tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:14.361759 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c8443514-a21f-4b74-90fd-f7183df297ed tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:14.362196 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c8443514-a21f-4b74-90fd-f7183df297ed tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:14.362876 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c8443514-a21f-4b74-90fd-f7183df297ed tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:14.363353 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c8443514-a21f-4b74-90fd-f7183df297ed tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:14.363770 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c8443514-a21f-4b74-90fd-f7183df297ed tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:14.501321 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-c8443514-a21f-4b74-90fd-f7183df297ed tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:14.509888 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-c8443514-a21f-4b74-90fd-f7183df297ed tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334" status: 200 len: 1265 microversion: 2.1 time: 0.159761 Oct 24 13:21:14.510478 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 497/967] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:14 2022] GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:15.170286 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-52de3c1f-ba9a-4b08-bace-943fea5af3ce req-000e316e-728c-4f61-8f25-d9bdc9b92447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "540ac816-895b-4737-8d42-9b2c7817f334", "name": "network-vif-plugged", "status": "completed", "tag": "6d9a9a89-0d40-45ae-b4f3-42bb1681566f"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:21:15.183680 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-52de3c1f-ba9a-4b08-bace-943fea5af3ce req-000e316e-728c-4f61-8f25-d9bdc9b92447 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:15.184161 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-52de3c1f-ba9a-4b08-bace-943fea5af3ce req-000e316e-728c-4f61-8f25-d9bdc9b92447 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:15.184770 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-52de3c1f-ba9a-4b08-bace-943fea5af3ce req-000e316e-728c-4f61-8f25-d9bdc9b92447 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:15.199551 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-52de3c1f-ba9a-4b08-bace-943fea5af3ce req-000e316e-728c-4f61-8f25-d9bdc9b92447 service nova] Creating event network-vif-plugged:6d9a9a89-0d40-45ae-b4f3-42bb1681566f for instance 540ac816-895b-4737-8d42-9b2c7817f334 on hv-cinder-86248 Oct 24 13:21:15.205816 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-52de3c1f-ba9a-4b08-bace-943fea5af3ce req-000e316e-728c-4f61-8f25-d9bdc9b92447 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039732 Oct 24 13:21:15.206633 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 471/968] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:21:15.533772 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-4617606f-8ce2-4425-8aff-95e340b8364a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:15.535457 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-4617606f-8ce2-4425-8aff-95e340b8364a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:15.542057 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4617606f-8ce2-4425-8aff-95e340b8364a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:15.543289 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4617606f-8ce2-4425-8aff-95e340b8364a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:15.543733 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4617606f-8ce2-4425-8aff-95e340b8364a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:15.544445 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4617606f-8ce2-4425-8aff-95e340b8364a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:15.544976 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4617606f-8ce2-4425-8aff-95e340b8364a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:15.545409 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4617606f-8ce2-4425-8aff-95e340b8364a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:15.686608 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-4617606f-8ce2-4425-8aff-95e340b8364a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:15.696028 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-4617606f-8ce2-4425-8aff-95e340b8364a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334" status: 200 len: 1265 microversion: 2.1 time: 0.166018 Oct 24 13:21:15.697062 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 498/969] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:15 2022] GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:16.721116 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-fbcb5fa9-5443-40bf-80ce-f5d618d87d76 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:16.723330 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-fbcb5fa9-5443-40bf-80ce-f5d618d87d76 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:16.730048 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fbcb5fa9-5443-40bf-80ce-f5d618d87d76 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:16.731486 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fbcb5fa9-5443-40bf-80ce-f5d618d87d76 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:16.731486 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fbcb5fa9-5443-40bf-80ce-f5d618d87d76 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:16.731872 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fbcb5fa9-5443-40bf-80ce-f5d618d87d76 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:16.732546 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fbcb5fa9-5443-40bf-80ce-f5d618d87d76 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:16.732972 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fbcb5fa9-5443-40bf-80ce-f5d618d87d76 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:16.875162 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-fbcb5fa9-5443-40bf-80ce-f5d618d87d76 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:16.882935 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-fbcb5fa9-5443-40bf-80ce-f5d618d87d76 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334" status: 200 len: 1265 microversion: 2.1 time: 0.167428 Oct 24 13:21:16.883516 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 472/970] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:16 2022] GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:17.906779 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-43aef6a6-d472-4070-a6eb-e3c65e555d12 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:17.907440 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-43aef6a6-d472-4070-a6eb-e3c65e555d12 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:17.914253 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-43aef6a6-d472-4070-a6eb-e3c65e555d12 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:17.914740 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-43aef6a6-d472-4070-a6eb-e3c65e555d12 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:17.915220 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-43aef6a6-d472-4070-a6eb-e3c65e555d12 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:17.915920 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-43aef6a6-d472-4070-a6eb-e3c65e555d12 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:17.916373 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-43aef6a6-d472-4070-a6eb-e3c65e555d12 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:17.916796 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-43aef6a6-d472-4070-a6eb-e3c65e555d12 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:18.050912 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-43aef6a6-d472-4070-a6eb-e3c65e555d12 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:18.058762 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-43aef6a6-d472-4070-a6eb-e3c65e555d12 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334" status: 200 len: 1451 microversion: 2.1 time: 0.156616 Oct 24 13:21:18.059348 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 499/971] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:17 2022] GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:18.082443 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-7a50e076-8e30-40c1-b618-ad972130cb94 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:18.083036 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-7a50e076-8e30-40c1-b618-ad972130cb94 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:18.089386 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7a50e076-8e30-40c1-b618-ad972130cb94 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:18.089857 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7a50e076-8e30-40c1-b618-ad972130cb94 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:18.090413 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7a50e076-8e30-40c1-b618-ad972130cb94 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:18.091128 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7a50e076-8e30-40c1-b618-ad972130cb94 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:18.091856 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7a50e076-8e30-40c1-b618-ad972130cb94 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:18.092386 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-7a50e076-8e30-40c1-b618-ad972130cb94 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:18.232145 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-7a50e076-8e30-40c1-b618-ad972130cb94 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:18.240201 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-7a50e076-8e30-40c1-b618-ad972130cb94 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334" status: 200 len: 1451 microversion: 2.1 time: 0.162740 Oct 24 13:21:18.240774 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 473/972] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:18 2022] GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:20.332688 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-520e7d4f-ec21-4288-a383-edbded2c6f9a req-1de99d9b-4134-4a8a-9ba1-1ac8d9520c61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "540ac816-895b-4737-8d42-9b2c7817f334", "tag": "6d9a9a89-0d40-45ae-b4f3-42bb1681566f"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:21:20.342322 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-520e7d4f-ec21-4288-a383-edbded2c6f9a req-1de99d9b-4134-4a8a-9ba1-1ac8d9520c61 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:20.342874 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-520e7d4f-ec21-4288-a383-edbded2c6f9a req-1de99d9b-4134-4a8a-9ba1-1ac8d9520c61 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:20.343389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-520e7d4f-ec21-4288-a383-edbded2c6f9a req-1de99d9b-4134-4a8a-9ba1-1ac8d9520c61 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:20.355162 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-520e7d4f-ec21-4288-a383-edbded2c6f9a req-1de99d9b-4134-4a8a-9ba1-1ac8d9520c61 service nova] Creating event network-changed:6d9a9a89-0d40-45ae-b4f3-42bb1681566f for instance 540ac816-895b-4737-8d42-9b2c7817f334 on hv-cinder-86248 Oct 24 13:21:20.360400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-520e7d4f-ec21-4288-a383-edbded2c6f9a req-1de99d9b-4134-4a8a-9ba1-1ac8d9520c61 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032622 Oct 24 13:21:20.361109 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 500/973] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:21:43.066356 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9e3be415-8845-4414-a721-d84aa6fa47b7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1735112720", "imageRef": "4d2e5f3e-4aee-48d2-8ada-0b420d141f1b", "flavorRef": "452"}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:21:43.074365 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:21:43.075012 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=48 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:21:43.120815 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.network.neutron [None req-9e3be415-8845-4414-a721-d84aa6fa47b7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] validate_networks() for None {{(pid=118915) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:21:43.631621 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-9e3be415-8845-4414-a721-d84aa6fa47b7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Flavor limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:21:43.632052 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-9e3be415-8845-4414-a721-d84aa6fa47b7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Image limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:21:43.632530 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-9e3be415-8845-4414-a721-d84aa6fa47b7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Flavor pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:21:43.632945 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-9e3be415-8845-4414-a721-d84aa6fa47b7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Image pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:21:43.633362 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-9e3be415-8845-4414-a721-d84aa6fa47b7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:21:43.642613 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9e3be415-8845-4414-a721-d84aa6fa47b7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:43.643128 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9e3be415-8845-4414-a721-d84aa6fa47b7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:43.643569 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9e3be415-8845-4414-a721-d84aa6fa47b7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:43.644319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9e3be415-8845-4414-a721-d84aa6fa47b7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:43.644831 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9e3be415-8845-4414-a721-d84aa6fa47b7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:43.645257 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9e3be415-8845-4414-a721-d84aa6fa47b7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:43.662069 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-9e3be415-8845-4414-a721-d84aa6fa47b7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Getting quotas for project a827ef206ac2466b8b28f472bd1d4813. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:21:43.666004 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-9e3be415-8845-4414-a721-d84aa6fa47b7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Getting quotas for user 3f411b926c43411fa9b41fc40055d1e9 and project a827ef206ac2466b8b28f472bd1d4813. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:21:43.677196 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9e3be415-8845-4414-a721-d84aa6fa47b7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Going to run 1 instances... {{(pid=118915) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:21:43.679527 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9e3be415-8845-4414-a721-d84aa6fa47b7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] [instance: c0aa1750-018c-4c2f-91c5-6547f75c9517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4d2e5f3e-4aee-48d2-8ada-0b420d141f1b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:21:43.724608 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-9e3be415-8845-4414-a721-d84aa6fa47b7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662012 Oct 24 13:21:43.725249 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 474/974] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 24 13:21:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:21:43.734068 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=22 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:21:43.735244 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=50 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:21:43.740147 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a7547501-bcd6-4aa3-954a-9a13f996f4fb tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:43.741073 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a7547501-bcd6-4aa3-954a-9a13f996f4fb tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] [instance: c0aa1750-018c-4c2f-91c5-6547f75c9517] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:43.797225 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a7547501-bcd6-4aa3-954a-9a13f996f4fb tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f411b926c43411fa9b41fc40055d1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827ef206ac2466b8b28f472bd1d4813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:43.804270 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a7547501-bcd6-4aa3-954a-9a13f996f4fb tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] 10.222.0.42 "GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517" status: 200 len: 1215 microversion: 2.1 time: 0.071690 Oct 24 13:21:43.804839 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 501/975] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:43 2022] GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:44.828951 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-bcdf3f2e-982c-4fb7-875d-c35b2e831d6d tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:44.829699 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-bcdf3f2e-982c-4fb7-875d-c35b2e831d6d tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] [instance: c0aa1750-018c-4c2f-91c5-6547f75c9517] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:44.837427 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bcdf3f2e-982c-4fb7-875d-c35b2e831d6d tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:44.838253 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bcdf3f2e-982c-4fb7-875d-c35b2e831d6d tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:44.838790 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bcdf3f2e-982c-4fb7-875d-c35b2e831d6d tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:44.839610 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bcdf3f2e-982c-4fb7-875d-c35b2e831d6d tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:44.840346 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bcdf3f2e-982c-4fb7-875d-c35b2e831d6d tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:44.840840 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-bcdf3f2e-982c-4fb7-875d-c35b2e831d6d tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:44.956490 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-bcdf3f2e-982c-4fb7-875d-c35b2e831d6d tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f411b926c43411fa9b41fc40055d1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827ef206ac2466b8b28f472bd1d4813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:44.964803 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-bcdf3f2e-982c-4fb7-875d-c35b2e831d6d tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] 10.222.0.42 "GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517" status: 200 len: 1273 microversion: 2.1 time: 0.140956 Oct 24 13:21:44.965392 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 475/976] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:44 2022] GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517 => generated 1273 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:45.989991 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-9057bd49-0f66-4375-8341-4678f67ef59d tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:45.991461 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-9057bd49-0f66-4375-8341-4678f67ef59d tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] [instance: c0aa1750-018c-4c2f-91c5-6547f75c9517] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:46.003998 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9057bd49-0f66-4375-8341-4678f67ef59d tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:46.005727 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9057bd49-0f66-4375-8341-4678f67ef59d tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:46.006399 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9057bd49-0f66-4375-8341-4678f67ef59d tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:46.007169 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9057bd49-0f66-4375-8341-4678f67ef59d tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:46.007645 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9057bd49-0f66-4375-8341-4678f67ef59d tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:46.008139 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9057bd49-0f66-4375-8341-4678f67ef59d tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:46.137712 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-9057bd49-0f66-4375-8341-4678f67ef59d tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f411b926c43411fa9b41fc40055d1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827ef206ac2466b8b28f472bd1d4813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:46.145481 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-9057bd49-0f66-4375-8341-4678f67ef59d tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] 10.222.0.42 "GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517" status: 200 len: 1315 microversion: 2.1 time: 0.159876 Oct 24 13:21:46.145979 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 502/977] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:45 2022] GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:46.212726 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-c3ae2a65-a87e-4fc4-bb23-9ecdfc9ad048 req-32cf9239-c555-43fe-b92d-5437ad72b312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0aa1750-018c-4c2f-91c5-6547f75c9517", "tag": "c7a7e2f1-7813-481c-b223-a86d13080a67"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:21:46.222721 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-c3ae2a65-a87e-4fc4-bb23-9ecdfc9ad048 req-32cf9239-c555-43fe-b92d-5437ad72b312 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:46.223227 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-c3ae2a65-a87e-4fc4-bb23-9ecdfc9ad048 req-32cf9239-c555-43fe-b92d-5437ad72b312 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:46.223703 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-c3ae2a65-a87e-4fc4-bb23-9ecdfc9ad048 req-32cf9239-c555-43fe-b92d-5437ad72b312 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:46.236908 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-c3ae2a65-a87e-4fc4-bb23-9ecdfc9ad048 req-32cf9239-c555-43fe-b92d-5437ad72b312 service nova] Creating event network-changed:c7a7e2f1-7813-481c-b223-a86d13080a67 for instance c0aa1750-018c-4c2f-91c5-6547f75c9517 on hv-cinder-86248 Oct 24 13:21:46.243003 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-c3ae2a65-a87e-4fc4-bb23-9ecdfc9ad048 req-32cf9239-c555-43fe-b92d-5437ad72b312 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033819 Oct 24 13:21:46.244000 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 476/978] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:21:47.168045 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-42f6c57c-20fb-4404-9726-695eaa51de52 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:47.168662 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-42f6c57c-20fb-4404-9726-695eaa51de52 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] [instance: c0aa1750-018c-4c2f-91c5-6547f75c9517] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:47.175023 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-42f6c57c-20fb-4404-9726-695eaa51de52 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:47.175536 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-42f6c57c-20fb-4404-9726-695eaa51de52 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:47.175971 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-42f6c57c-20fb-4404-9726-695eaa51de52 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:47.176657 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-42f6c57c-20fb-4404-9726-695eaa51de52 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:47.177111 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-42f6c57c-20fb-4404-9726-695eaa51de52 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:47.177533 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-42f6c57c-20fb-4404-9726-695eaa51de52 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:47.307523 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-42f6c57c-20fb-4404-9726-695eaa51de52 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f411b926c43411fa9b41fc40055d1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827ef206ac2466b8b28f472bd1d4813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:47.315443 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-42f6c57c-20fb-4404-9726-695eaa51de52 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] 10.222.0.42 "GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517" status: 200 len: 1315 microversion: 2.1 time: 0.151183 Oct 24 13:21:47.316026 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 503/979] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:47 2022] GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:48.340466 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-a1f8c6bf-37c2-45e1-96d7-bd8cde9d2707 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:48.341168 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-a1f8c6bf-37c2-45e1-96d7-bd8cde9d2707 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] [instance: c0aa1750-018c-4c2f-91c5-6547f75c9517] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:48.347300 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a1f8c6bf-37c2-45e1-96d7-bd8cde9d2707 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:48.348429 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a1f8c6bf-37c2-45e1-96d7-bd8cde9d2707 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:48.348968 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a1f8c6bf-37c2-45e1-96d7-bd8cde9d2707 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:48.349525 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a1f8c6bf-37c2-45e1-96d7-bd8cde9d2707 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:48.349977 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a1f8c6bf-37c2-45e1-96d7-bd8cde9d2707 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:48.350398 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a1f8c6bf-37c2-45e1-96d7-bd8cde9d2707 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:48.480418 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-a1f8c6bf-37c2-45e1-96d7-bd8cde9d2707 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f411b926c43411fa9b41fc40055d1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827ef206ac2466b8b28f472bd1d4813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:48.487983 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-a1f8c6bf-37c2-45e1-96d7-bd8cde9d2707 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] 10.222.0.42 "GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517" status: 200 len: 1315 microversion: 2.1 time: 0.152164 Oct 24 13:21:48.488678 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 477/980] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:48 2022] GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:49.509700 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a07cc911-f720-4ebf-a8e1-8efea58085bd tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:49.510409 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a07cc911-f720-4ebf-a8e1-8efea58085bd tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] [instance: c0aa1750-018c-4c2f-91c5-6547f75c9517] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:49.517205 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a07cc911-f720-4ebf-a8e1-8efea58085bd tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:49.517686 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a07cc911-f720-4ebf-a8e1-8efea58085bd tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:49.518122 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a07cc911-f720-4ebf-a8e1-8efea58085bd tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:49.518810 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a07cc911-f720-4ebf-a8e1-8efea58085bd tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:49.519286 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a07cc911-f720-4ebf-a8e1-8efea58085bd tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:49.519784 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a07cc911-f720-4ebf-a8e1-8efea58085bd tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:49.652092 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a07cc911-f720-4ebf-a8e1-8efea58085bd tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f411b926c43411fa9b41fc40055d1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827ef206ac2466b8b28f472bd1d4813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:49.659592 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a07cc911-f720-4ebf-a8e1-8efea58085bd tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] 10.222.0.42 "GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517" status: 200 len: 1315 microversion: 2.1 time: 0.153732 Oct 24 13:21:49.660650 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 504/981] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:49 2022] GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:50.683375 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-aa638b11-2e8f-4b43-935a-fd9fb8ee35c4 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:50.683992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-aa638b11-2e8f-4b43-935a-fd9fb8ee35c4 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] [instance: c0aa1750-018c-4c2f-91c5-6547f75c9517] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:50.690436 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aa638b11-2e8f-4b43-935a-fd9fb8ee35c4 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:50.690918 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aa638b11-2e8f-4b43-935a-fd9fb8ee35c4 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:50.692086 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aa638b11-2e8f-4b43-935a-fd9fb8ee35c4 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:50.692893 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aa638b11-2e8f-4b43-935a-fd9fb8ee35c4 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:50.693351 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aa638b11-2e8f-4b43-935a-fd9fb8ee35c4 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:50.693776 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-aa638b11-2e8f-4b43-935a-fd9fb8ee35c4 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:50.826618 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-aa638b11-2e8f-4b43-935a-fd9fb8ee35c4 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f411b926c43411fa9b41fc40055d1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827ef206ac2466b8b28f472bd1d4813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:50.834401 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-aa638b11-2e8f-4b43-935a-fd9fb8ee35c4 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] 10.222.0.42 "GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517" status: 200 len: 1315 microversion: 2.1 time: 0.154985 Oct 24 13:21:50.834963 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 478/982] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:50 2022] GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:51.272289 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-8e8ff2df-3c70-4781-a40d-6e0982be8bc0 req-b4824d73-6662-41a8-8c2e-06cd69d3e759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0aa1750-018c-4c2f-91c5-6547f75c9517", "name": "network-vif-plugged", "status": "completed", "tag": "c7a7e2f1-7813-481c-b223-a86d13080a67"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:21:51.282013 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-8e8ff2df-3c70-4781-a40d-6e0982be8bc0 req-b4824d73-6662-41a8-8c2e-06cd69d3e759 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:51.282495 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-8e8ff2df-3c70-4781-a40d-6e0982be8bc0 req-b4824d73-6662-41a8-8c2e-06cd69d3e759 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:51.282923 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-8e8ff2df-3c70-4781-a40d-6e0982be8bc0 req-b4824d73-6662-41a8-8c2e-06cd69d3e759 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:51.294847 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-8e8ff2df-3c70-4781-a40d-6e0982be8bc0 req-b4824d73-6662-41a8-8c2e-06cd69d3e759 service nova] Creating event network-vif-plugged:c7a7e2f1-7813-481c-b223-a86d13080a67 for instance c0aa1750-018c-4c2f-91c5-6547f75c9517 on hv-cinder-86248 Oct 24 13:21:51.299816 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-8e8ff2df-3c70-4781-a40d-6e0982be8bc0 req-b4824d73-6662-41a8-8c2e-06cd69d3e759 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031764 Oct 24 13:21:51.300427 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 505/983] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:21:51.858223 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9c5cb506-c518-4edd-ae64-1b3cc50fdfe9 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:51.858834 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9c5cb506-c518-4edd-ae64-1b3cc50fdfe9 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] [instance: c0aa1750-018c-4c2f-91c5-6547f75c9517] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:51.865203 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9c5cb506-c518-4edd-ae64-1b3cc50fdfe9 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:51.865684 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9c5cb506-c518-4edd-ae64-1b3cc50fdfe9 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:51.866109 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9c5cb506-c518-4edd-ae64-1b3cc50fdfe9 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:51.866787 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9c5cb506-c518-4edd-ae64-1b3cc50fdfe9 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:51.867273 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9c5cb506-c518-4edd-ae64-1b3cc50fdfe9 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:51.867695 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9c5cb506-c518-4edd-ae64-1b3cc50fdfe9 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:52.003018 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-9c5cb506-c518-4edd-ae64-1b3cc50fdfe9 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f411b926c43411fa9b41fc40055d1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827ef206ac2466b8b28f472bd1d4813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:52.012053 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-9c5cb506-c518-4edd-ae64-1b3cc50fdfe9 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] 10.222.0.42 "GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517" status: 200 len: 1315 microversion: 2.1 time: 0.157605 Oct 24 13:21:52.012665 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 479/984] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:51 2022] GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:53.037753 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-ee135514-53f0-42ab-a512-5bd0ed70f3f7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:53.038460 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-ee135514-53f0-42ab-a512-5bd0ed70f3f7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] [instance: c0aa1750-018c-4c2f-91c5-6547f75c9517] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:53.044607 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ee135514-53f0-42ab-a512-5bd0ed70f3f7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:53.045305 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ee135514-53f0-42ab-a512-5bd0ed70f3f7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:53.045744 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ee135514-53f0-42ab-a512-5bd0ed70f3f7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:53.046440 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ee135514-53f0-42ab-a512-5bd0ed70f3f7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:53.046932 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ee135514-53f0-42ab-a512-5bd0ed70f3f7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:53.047446 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ee135514-53f0-42ab-a512-5bd0ed70f3f7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:53.176936 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-ee135514-53f0-42ab-a512-5bd0ed70f3f7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f411b926c43411fa9b41fc40055d1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827ef206ac2466b8b28f472bd1d4813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:53.184556 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-ee135514-53f0-42ab-a512-5bd0ed70f3f7 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] 10.222.0.42 "GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517" status: 200 len: 1464 microversion: 2.1 time: 0.152426 Oct 24 13:21:53.185131 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 506/985] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:53 2022] GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517 => generated 1464 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:53.230810 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-c620062a-a41d-4e9a-a468-b0c3841faf12 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:53.231352 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-c620062a-a41d-4e9a-a468-b0c3841faf12 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] [instance: c0aa1750-018c-4c2f-91c5-6547f75c9517] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:53.237618 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c620062a-a41d-4e9a-a468-b0c3841faf12 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:53.238099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c620062a-a41d-4e9a-a468-b0c3841faf12 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:53.238529 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c620062a-a41d-4e9a-a468-b0c3841faf12 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:53.239243 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c620062a-a41d-4e9a-a468-b0c3841faf12 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:53.239696 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c620062a-a41d-4e9a-a468-b0c3841faf12 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:53.240119 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c620062a-a41d-4e9a-a468-b0c3841faf12 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:53.265189 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-c620062a-a41d-4e9a-a468-b0c3841faf12 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] [instance: c0aa1750-018c-4c2f-91c5-6547f75c9517] Going to try to terminate instance {{(pid=118915) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:21:53.338456 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-c620062a-a41d-4e9a-a468-b0c3841faf12 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517" status: 204 len: 0 microversion: 2.1 time: 0.111057 Oct 24 13:21:53.339335 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 480/986] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:21:53 2022] DELETE /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:21:53.347598 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-6d5398a5-356f-42af-9ac1-f6b46007d282 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:53.348210 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-6d5398a5-356f-42af-9ac1-f6b46007d282 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] [instance: c0aa1750-018c-4c2f-91c5-6547f75c9517] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:53.354131 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6d5398a5-356f-42af-9ac1-f6b46007d282 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:53.354610 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6d5398a5-356f-42af-9ac1-f6b46007d282 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:53.355041 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6d5398a5-356f-42af-9ac1-f6b46007d282 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:53.355750 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6d5398a5-356f-42af-9ac1-f6b46007d282 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:53.356205 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6d5398a5-356f-42af-9ac1-f6b46007d282 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:53.356634 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-6d5398a5-356f-42af-9ac1-f6b46007d282 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:53.487921 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-6d5398a5-356f-42af-9ac1-f6b46007d282 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f411b926c43411fa9b41fc40055d1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827ef206ac2466b8b28f472bd1d4813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:53.496266 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-6d5398a5-356f-42af-9ac1-f6b46007d282 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] 10.222.0.42 "GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517" status: 200 len: 1470 microversion: 2.1 time: 0.152475 Oct 24 13:21:53.496829 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 507/987] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:53 2022] GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:54.522204 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-40f4d566-ac45-421d-9c10-8eec8ff69cd4 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:54.522904 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-40f4d566-ac45-421d-9c10-8eec8ff69cd4 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] [instance: c0aa1750-018c-4c2f-91c5-6547f75c9517] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:54.524829 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=2 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:21:54.525482 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=6 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:21:54.531927 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-40f4d566-ac45-421d-9c10-8eec8ff69cd4 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:54.532407 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-40f4d566-ac45-421d-9c10-8eec8ff69cd4 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:54.532834 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-40f4d566-ac45-421d-9c10-8eec8ff69cd4 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:54.533891 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-40f4d566-ac45-421d-9c10-8eec8ff69cd4 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:54.534307 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-40f4d566-ac45-421d-9c10-8eec8ff69cd4 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:54.534730 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-40f4d566-ac45-421d-9c10-8eec8ff69cd4 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:54.673656 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-40f4d566-ac45-421d-9c10-8eec8ff69cd4 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f411b926c43411fa9b41fc40055d1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827ef206ac2466b8b28f472bd1d4813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:54.682368 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-40f4d566-ac45-421d-9c10-8eec8ff69cd4 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] 10.222.0.42 "GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517" status: 200 len: 1470 microversion: 2.1 time: 0.165634 Oct 24 13:21:54.682875 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 481/988] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:54 2022] GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517 => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:55.212618 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-67b70724-aad2-4c1e-94e2-6c77680e7700 req-0983af85-9e3d-418d-ac7a-24012b0aa104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0aa1750-018c-4c2f-91c5-6547f75c9517", "name": "network-vif-deleted", "tag": "c7a7e2f1-7813-481c-b223-a86d13080a67"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:21:55.218065 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=2 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:21:55.228170 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-67b70724-aad2-4c1e-94e2-6c77680e7700 req-0983af85-9e3d-418d-ac7a-24012b0aa104 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:55.228863 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-67b70724-aad2-4c1e-94e2-6c77680e7700 req-0983af85-9e3d-418d-ac7a-24012b0aa104 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:55.229533 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-67b70724-aad2-4c1e-94e2-6c77680e7700 req-0983af85-9e3d-418d-ac7a-24012b0aa104 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:55.242742 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-67b70724-aad2-4c1e-94e2-6c77680e7700 req-0983af85-9e3d-418d-ac7a-24012b0aa104 service nova] Creating event network-vif-deleted:c7a7e2f1-7813-481c-b223-a86d13080a67 for instance c0aa1750-018c-4c2f-91c5-6547f75c9517 on hv-cinder-86248 Oct 24 13:21:55.249018 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-67b70724-aad2-4c1e-94e2-6c77680e7700 req-0983af85-9e3d-418d-ac7a-24012b0aa104 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040895 Oct 24 13:21:55.250130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 508/989] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:21:55.705457 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-0f6ffea2-47c3-4f55-b954-32bb913a3c39 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:55.706023 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-0f6ffea2-47c3-4f55-b954-32bb913a3c39 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] [instance: c0aa1750-018c-4c2f-91c5-6547f75c9517] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:55.713024 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f6ffea2-47c3-4f55-b954-32bb913a3c39 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:55.713501 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f6ffea2-47c3-4f55-b954-32bb913a3c39 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:55.713935 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f6ffea2-47c3-4f55-b954-32bb913a3c39 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:55.714618 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f6ffea2-47c3-4f55-b954-32bb913a3c39 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:55.715078 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f6ffea2-47c3-4f55-b954-32bb913a3c39 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:55.715507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f6ffea2-47c3-4f55-b954-32bb913a3c39 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:55.746973 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f6ffea2-47c3-4f55-b954-32bb913a3c39 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:55.747509 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f6ffea2-47c3-4f55-b954-32bb913a3c39 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:55.747938 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f6ffea2-47c3-4f55-b954-32bb913a3c39 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:55.748391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.objects.instance [None req-0f6ffea2-47c3-4f55-b954-32bb913a3c39 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lazy-loading 'fault' on Instance uuid c0aa1750-018c-4c2f-91c5-6547f75c9517 {{(pid=118915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:21:55.791589 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-0f6ffea2-47c3-4f55-b954-32bb913a3c39 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f411b926c43411fa9b41fc40055d1e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a827ef206ac2466b8b28f472bd1d4813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:21:55.799137 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-0f6ffea2-47c3-4f55-b954-32bb913a3c39 tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] 10.222.0.42 "GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517" status: 200 len: 1305 microversion: 2.1 time: 0.097828 Oct 24 13:21:55.800033 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 482/990] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:55 2022] GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517 => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:21:56.830281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-7438416b-8bde-47a9-9596-5379841773dc tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:21:56.831002 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-7438416b-8bde-47a9-9596-5379841773dc tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] [instance: c0aa1750-018c-4c2f-91c5-6547f75c9517] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:21:56.838156 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7438416b-8bde-47a9-9596-5379841773dc tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:56.838628 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7438416b-8bde-47a9-9596-5379841773dc tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:56.839080 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7438416b-8bde-47a9-9596-5379841773dc tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:56.839761 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7438416b-8bde-47a9-9596-5379841773dc tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:21:56.840208 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7438416b-8bde-47a9-9596-5379841773dc tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:21:56.840623 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7438416b-8bde-47a9-9596-5379841773dc tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:21:56.854606 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-7438416b-8bde-47a9-9596-5379841773dc tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] HTTP exception thrown: Instance c0aa1750-018c-4c2f-91c5-6547f75c9517 could not be found. Oct 24 13:21:56.856229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-7438416b-8bde-47a9-9596-5379841773dc tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Request method failure captured: Oct 24 13:21:56.856229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517 HTTP/1.1 Oct 24 13:21:56.856229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:21:56.856229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:21:56.856229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:21:56.856229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:21:56.856229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:21:56.856229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:21:56.856229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:21:56.856229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:21:56.856229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVpFlUDr8wNkfsio5bHaMSQ4G0FSpfTilozDYl0elpNrXdDl2ZZHUoY0lmDWC5hX1nmQcSZRPI4VXOcXJTjM6V30TXITEBW0ADQZJIat_6zOX39Jnz26c3fj0FJZi0HSRVzmBiykFEPkJid1x_f-9o-Xrhe0eO5Kp5XnSWsBqVY8AQbs Oct 24 13:21:56.856229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:21:56.856229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:21:56.856229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:21:56.856229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:21:56.856229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:21:56.856229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:21:56.856229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: a827ef206ac2466b8b28f472bd1d4813 Oct 24 13:21:56.856229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-VolumesNegativeTest-1474860219 Oct 24 13:21:56.856229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:21:56.856229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:21:56.857986 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a827ef206ac2466b8b28f472bd1d4813"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a827ef206ac2466b8b28f472bd1d4813"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a827ef206ac2466b8b28f472bd1d4813"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a827ef206ac2466b8b28f472bd1d4813"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:21:56.857986 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-VolumesNegativeTest-1474860219 Oct 24 13:21:56.857986 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: a827ef206ac2466b8b28f472bd1d4813 Oct 24 13:21:56.857986 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-VolumesNegativeTest-1474860219 Oct 24 13:21:56.857986 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-VolumesNegativeTest-1474860219-project Oct 24 13:21:56.857986 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:21:56.857986 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:21:56.857986 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: 3f411b926c43411fa9b41fc40055d1e9 Oct 24 13:21:56.857986 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-VolumesNegativeTest-1474860219-project Oct 24 13:21:56.857986 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:21:56.857986 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Instance c0aa1750-018c-4c2f-91c5-6547f75c9517 could not be found. Oct 24 13:21:56.857986 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': 'c0aa1750-018c-4c2f-91c5-6547f75c9517'} Oct 24 13:21:56.859232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:21:56.859232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:21:56.859232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:21:56.859232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:21:56.859232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:21:56.859232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:21:56.859232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:21:56.859232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:21:56.859232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:21:56.859232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:21:56.859232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0aa1750-018c-4c2f-91c5-6547f75c9517 could not be found. Oct 24 13:21:56.859232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:21:56.859232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:21:56.859232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:21:56.859232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:21:56.859232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:21:56.859232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:21:56.859232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:21:56.859232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:21:56.859232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:21:56.860938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:21:56.860938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:21:56.860938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:21:56.860938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:21:56.860938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:21:56.860938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:21:56.860938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:21:56.860938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0aa1750-018c-4c2f-91c5-6547f75c9517 could not be found. Oct 24 13:21:56.860938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:21:56.860938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:21:56.860938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:21:56.860938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:21:56.860938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:21:56.860938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:21:56.860938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:21:56.860938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:21:56.860938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0aa1750-018c-4c2f-91c5-6547f75c9517 could not be found. Oct 24 13:21:56.860938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:21:56.862457 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-7438416b-8bde-47a9-9596-5379841773dc tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] Returning 404 to user: Instance c0aa1750-018c-4c2f-91c5-6547f75c9517 could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:21:56.862457 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-7438416b-8bde-47a9-9596-5379841773dc tempest-VolumesNegativeTest-1474860219 tempest-VolumesNegativeTest-1474860219-project] 10.222.0.42 "GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517" status: 404 len: 111 microversion: 2.1 time: 0.031674 Oct 24 13:21:56.862457 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 509/991] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:21:56 2022] GET /compute/v2.1/servers/c0aa1750-018c-4c2f-91c5-6547f75c9517 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:22:23.869296 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-fa7f69bd-cdc2-4d51-b1e8-85f2cb4a367e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:22:23.869881 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-fa7f69bd-cdc2-4d51-b1e8-85f2cb4a367e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:23.872098 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:22:23.872879 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:22:23.878402 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fa7f69bd-cdc2-4d51-b1e8-85f2cb4a367e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:23.878884 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fa7f69bd-cdc2-4d51-b1e8-85f2cb4a367e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:23.879345 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fa7f69bd-cdc2-4d51-b1e8-85f2cb4a367e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:23.880034 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fa7f69bd-cdc2-4d51-b1e8-85f2cb4a367e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:23.880491 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fa7f69bd-cdc2-4d51-b1e8-85f2cb4a367e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:23.880912 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fa7f69bd-cdc2-4d51-b1e8-85f2cb4a367e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:23.905417 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.objects.instance [None req-fa7f69bd-cdc2-4d51-b1e8-85f2cb4a367e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lazy-loading 'flavor' on Instance uuid 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 {{(pid=118915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:22:23.979528 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-fa7f69bd-cdc2-4d51-b1e8-85f2cb4a367e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "POST /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8/action" status: 202 len: 0 microversion: 2.1 time: 0.114580 Oct 24 13:22:23.980109 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 483/992] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 24 13:22:23 2022] POST /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:22:23.989088 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-931735d4-fb90-464d-83e3-fcffece47d03 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:22:23.989697 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-931735d4-fb90-464d-83e3-fcffece47d03 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:23.993236 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=20 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:22:23.994274 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=36 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:22:24.001113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-931735d4-fb90-464d-83e3-fcffece47d03 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:24.001597 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-931735d4-fb90-464d-83e3-fcffece47d03 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:24.002965 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-931735d4-fb90-464d-83e3-fcffece47d03 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:24.003797 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-931735d4-fb90-464d-83e3-fcffece47d03 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:24.004434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-931735d4-fb90-464d-83e3-fcffece47d03 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:24.004858 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-931735d4-fb90-464d-83e3-fcffece47d03 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:24.296898 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-931735d4-fb90-464d-83e3-fcffece47d03 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:22:24.304609 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-931735d4-fb90-464d-83e3-fcffece47d03 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1568 microversion: 2.1 time: 0.319695 Oct 24 13:22:24.305158 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 510/993] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:22:23 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1568 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:22:25.329176 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-28289454-154d-473e-b50b-ec35867ab0b8 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:22:25.329795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-28289454-154d-473e-b50b-ec35867ab0b8 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:25.336157 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-28289454-154d-473e-b50b-ec35867ab0b8 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:25.336641 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-28289454-154d-473e-b50b-ec35867ab0b8 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:25.337076 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-28289454-154d-473e-b50b-ec35867ab0b8 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:25.337769 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-28289454-154d-473e-b50b-ec35867ab0b8 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:25.338221 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-28289454-154d-473e-b50b-ec35867ab0b8 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:25.338641 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-28289454-154d-473e-b50b-ec35867ab0b8 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:25.524058 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-28289454-154d-473e-b50b-ec35867ab0b8 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:22:25.531909 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-28289454-154d-473e-b50b-ec35867ab0b8 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1568 microversion: 2.1 time: 0.207754 Oct 24 13:22:25.532465 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 484/994] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:22:25 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:22:26.556213 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-08ac7b9d-764b-48cf-ab9d-76975a0558f3 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:22:26.556883 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-08ac7b9d-764b-48cf-ab9d-76975a0558f3 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:26.563569 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08ac7b9d-764b-48cf-ab9d-76975a0558f3 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:26.564044 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08ac7b9d-764b-48cf-ab9d-76975a0558f3 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:26.564473 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08ac7b9d-764b-48cf-ab9d-76975a0558f3 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:26.565151 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08ac7b9d-764b-48cf-ab9d-76975a0558f3 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:26.565596 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08ac7b9d-764b-48cf-ab9d-76975a0558f3 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:26.566011 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08ac7b9d-764b-48cf-ab9d-76975a0558f3 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:26.693229 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-08ac7b9d-764b-48cf-ab9d-76975a0558f3 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:22:26.701583 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-08ac7b9d-764b-48cf-ab9d-76975a0558f3 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1568 microversion: 2.1 time: 0.149722 Oct 24 13:22:26.702139 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 511/995] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:22:26 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:22:27.724371 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-a24dd7d4-54cd-48c4-85c0-4f74c19835a6 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:22:27.724993 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-a24dd7d4-54cd-48c4-85c0-4f74c19835a6 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:27.731854 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a24dd7d4-54cd-48c4-85c0-4f74c19835a6 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:27.732336 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a24dd7d4-54cd-48c4-85c0-4f74c19835a6 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:27.732775 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a24dd7d4-54cd-48c4-85c0-4f74c19835a6 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:27.733461 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a24dd7d4-54cd-48c4-85c0-4f74c19835a6 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:27.733917 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a24dd7d4-54cd-48c4-85c0-4f74c19835a6 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:27.734338 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a24dd7d4-54cd-48c4-85c0-4f74c19835a6 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:27.862736 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-a24dd7d4-54cd-48c4-85c0-4f74c19835a6 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:22:27.871606 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-a24dd7d4-54cd-48c4-85c0-4f74c19835a6 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1568 microversion: 2.1 time: 0.151155 Oct 24 13:22:27.872172 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 485/996] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:22:27 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:22:28.896086 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-8165788d-a2a2-4bfc-86ed-35a813af43c1 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:22:28.896639 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-8165788d-a2a2-4bfc-86ed-35a813af43c1 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:28.903195 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8165788d-a2a2-4bfc-86ed-35a813af43c1 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:28.903679 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8165788d-a2a2-4bfc-86ed-35a813af43c1 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:28.904116 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8165788d-a2a2-4bfc-86ed-35a813af43c1 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:28.904796 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8165788d-a2a2-4bfc-86ed-35a813af43c1 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:28.905247 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8165788d-a2a2-4bfc-86ed-35a813af43c1 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:28.905668 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-8165788d-a2a2-4bfc-86ed-35a813af43c1 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:29.036731 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-8165788d-a2a2-4bfc-86ed-35a813af43c1 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:22:29.045089 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-8165788d-a2a2-4bfc-86ed-35a813af43c1 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1568 microversion: 2.1 time: 0.153040 Oct 24 13:22:29.045643 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 512/997] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:22:28 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:22:30.068791 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-5785d5c8-9ac1-49df-b6ca-f65070b3be90 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:22:30.069402 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-5785d5c8-9ac1-49df-b6ca-f65070b3be90 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:30.076403 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5785d5c8-9ac1-49df-b6ca-f65070b3be90 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:30.076887 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5785d5c8-9ac1-49df-b6ca-f65070b3be90 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:30.077320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5785d5c8-9ac1-49df-b6ca-f65070b3be90 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:30.078015 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5785d5c8-9ac1-49df-b6ca-f65070b3be90 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:30.078469 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5785d5c8-9ac1-49df-b6ca-f65070b3be90 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:30.078892 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-5785d5c8-9ac1-49df-b6ca-f65070b3be90 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:30.213261 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-5785d5c8-9ac1-49df-b6ca-f65070b3be90 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:22:30.220937 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-5785d5c8-9ac1-49df-b6ca-f65070b3be90 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1568 microversion: 2.1 time: 0.156037 Oct 24 13:22:30.221501 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 486/998] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:22:30 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:22:31.244179 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-06f7cc0a-3290-416c-a5c7-0b4d58173260 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:22:31.244793 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-06f7cc0a-3290-416c-a5c7-0b4d58173260 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:31.251360 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-06f7cc0a-3290-416c-a5c7-0b4d58173260 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:31.251837 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-06f7cc0a-3290-416c-a5c7-0b4d58173260 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:31.252263 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-06f7cc0a-3290-416c-a5c7-0b4d58173260 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:31.252941 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-06f7cc0a-3290-416c-a5c7-0b4d58173260 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:31.253385 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-06f7cc0a-3290-416c-a5c7-0b4d58173260 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:31.253829 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-06f7cc0a-3290-416c-a5c7-0b4d58173260 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:31.381338 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-06f7cc0a-3290-416c-a5c7-0b4d58173260 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:22:31.390107 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-06f7cc0a-3290-416c-a5c7-0b4d58173260 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1568 microversion: 2.1 time: 0.149964 Oct 24 13:22:31.390749 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 513/999] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:22:31 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:22:32.412533 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9a00d6ed-e1a0-46ae-9c9a-8a8891128c0a tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:22:32.413201 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9a00d6ed-e1a0-46ae-9c9a-8a8891128c0a tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:32.421402 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9a00d6ed-e1a0-46ae-9c9a-8a8891128c0a tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:32.421879 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9a00d6ed-e1a0-46ae-9c9a-8a8891128c0a tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:32.422310 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9a00d6ed-e1a0-46ae-9c9a-8a8891128c0a tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:32.422992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9a00d6ed-e1a0-46ae-9c9a-8a8891128c0a tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:32.423474 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9a00d6ed-e1a0-46ae-9c9a-8a8891128c0a tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:32.423895 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9a00d6ed-e1a0-46ae-9c9a-8a8891128c0a tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:32.560466 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-9a00d6ed-e1a0-46ae-9c9a-8a8891128c0a tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:22:32.568185 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-9a00d6ed-e1a0-46ae-9c9a-8a8891128c0a tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1568 microversion: 2.1 time: 0.159441 Oct 24 13:22:32.568752 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 487/1000] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:22:32 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:22:33.591685 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-c89cb321-7b5a-421f-9b9a-20d0f681b067 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:22:33.592301 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-c89cb321-7b5a-421f-9b9a-20d0f681b067 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:33.598613 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c89cb321-7b5a-421f-9b9a-20d0f681b067 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:33.599119 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c89cb321-7b5a-421f-9b9a-20d0f681b067 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:33.599557 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c89cb321-7b5a-421f-9b9a-20d0f681b067 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:33.600241 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c89cb321-7b5a-421f-9b9a-20d0f681b067 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:33.600692 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c89cb321-7b5a-421f-9b9a-20d0f681b067 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:33.601659 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-c89cb321-7b5a-421f-9b9a-20d0f681b067 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:33.734580 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-c89cb321-7b5a-421f-9b9a-20d0f681b067 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:22:33.743023 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-c89cb321-7b5a-421f-9b9a-20d0f681b067 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1568 microversion: 2.1 time: 0.155157 Oct 24 13:22:33.743609 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 514/1001] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:22:33 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:22:34.766102 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-ab7e9f9d-8432-44b0-bb4d-315ec4b72683 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:22:34.766711 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-ab7e9f9d-8432-44b0-bb4d-315ec4b72683 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:34.773851 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ab7e9f9d-8432-44b0-bb4d-315ec4b72683 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:34.774315 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ab7e9f9d-8432-44b0-bb4d-315ec4b72683 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:34.774742 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ab7e9f9d-8432-44b0-bb4d-315ec4b72683 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:34.775461 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ab7e9f9d-8432-44b0-bb4d-315ec4b72683 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:34.775911 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ab7e9f9d-8432-44b0-bb4d-315ec4b72683 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:34.776331 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ab7e9f9d-8432-44b0-bb4d-315ec4b72683 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:34.922584 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-ab7e9f9d-8432-44b0-bb4d-315ec4b72683 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:22:34.931286 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-ab7e9f9d-8432-44b0-bb4d-315ec4b72683 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1568 microversion: 2.1 time: 0.169024 Oct 24 13:22:34.931845 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 488/1002] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:22:34 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:22:35.954702 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-3badf040-fa25-450d-ac0c-8223bd2480fc tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:22:35.955387 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-3badf040-fa25-450d-ac0c-8223bd2480fc tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:35.962204 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3badf040-fa25-450d-ac0c-8223bd2480fc tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:35.962691 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3badf040-fa25-450d-ac0c-8223bd2480fc tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:35.963679 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3badf040-fa25-450d-ac0c-8223bd2480fc tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:35.964378 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3badf040-fa25-450d-ac0c-8223bd2480fc tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:35.964838 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3badf040-fa25-450d-ac0c-8223bd2480fc tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:35.965268 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3badf040-fa25-450d-ac0c-8223bd2480fc tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:36.093545 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-3badf040-fa25-450d-ac0c-8223bd2480fc tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:22:36.101213 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-3badf040-fa25-450d-ac0c-8223bd2480fc tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1568 microversion: 2.1 time: 0.150343 Oct 24 13:22:36.101776 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 515/1003] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:22:35 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:22:37.125037 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-2f61f997-7af1-478d-bee0-da4263f2b84e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:22:37.125650 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-2f61f997-7af1-478d-bee0-da4263f2b84e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:37.132121 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2f61f997-7af1-478d-bee0-da4263f2b84e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:37.133018 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2f61f997-7af1-478d-bee0-da4263f2b84e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:37.133459 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2f61f997-7af1-478d-bee0-da4263f2b84e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:37.134141 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2f61f997-7af1-478d-bee0-da4263f2b84e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:37.134592 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2f61f997-7af1-478d-bee0-da4263f2b84e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:37.135084 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2f61f997-7af1-478d-bee0-da4263f2b84e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:37.264443 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-2f61f997-7af1-478d-bee0-da4263f2b84e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:22:37.272281 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-2f61f997-7af1-478d-bee0-da4263f2b84e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1509 microversion: 2.1 time: 0.151181 Oct 24 13:22:37.272846 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 489/1004] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:22:37 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:22:37.295197 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-feeff822-5197-4024-9625-65a4b5b90ea3 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:22:37.295794 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-feeff822-5197-4024-9625-65a4b5b90ea3 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:37.302140 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-feeff822-5197-4024-9625-65a4b5b90ea3 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:37.302620 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-feeff822-5197-4024-9625-65a4b5b90ea3 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:37.303068 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-feeff822-5197-4024-9625-65a4b5b90ea3 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:37.303762 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-feeff822-5197-4024-9625-65a4b5b90ea3 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:37.304216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-feeff822-5197-4024-9625-65a4b5b90ea3 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:37.305033 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-feeff822-5197-4024-9625-65a4b5b90ea3 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:37.333588 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-feeff822-5197-4024-9625-65a4b5b90ea3 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118914) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 24 13:22:37.397282 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-feeff822-5197-4024-9625-65a4b5b90ea3 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "POST /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8/action" status: 202 len: 0 microversion: 2.1 time: 0.105910 Oct 24 13:22:37.399006 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 516/1005] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Oct 24 13:22:37 2022] POST /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:22:37.407210 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-ceb26c27-2c0a-4813-8f8c-dd238fe27d70 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:22:37.407958 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-ceb26c27-2c0a-4813-8f8c-dd238fe27d70 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:37.413829 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ceb26c27-2c0a-4813-8f8c-dd238fe27d70 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:37.414308 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ceb26c27-2c0a-4813-8f8c-dd238fe27d70 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:37.414741 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ceb26c27-2c0a-4813-8f8c-dd238fe27d70 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:37.415453 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ceb26c27-2c0a-4813-8f8c-dd238fe27d70 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:37.415902 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ceb26c27-2c0a-4813-8f8c-dd238fe27d70 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:37.416319 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ceb26c27-2c0a-4813-8f8c-dd238fe27d70 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:37.555673 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-ceb26c27-2c0a-4813-8f8c-dd238fe27d70 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:22:37.563524 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-ceb26c27-2c0a-4813-8f8c-dd238fe27d70 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1517 microversion: 2.1 time: 0.160373 Oct 24 13:22:37.564088 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 490/1006] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:22:37 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:22:38.586266 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-3af14656-9b39-4f84-8b2e-b7d5a892f70b tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:22:38.586912 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-3af14656-9b39-4f84-8b2e-b7d5a892f70b tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:38.593498 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3af14656-9b39-4f84-8b2e-b7d5a892f70b tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:38.593992 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3af14656-9b39-4f84-8b2e-b7d5a892f70b tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:38.594426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3af14656-9b39-4f84-8b2e-b7d5a892f70b tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:38.595143 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3af14656-9b39-4f84-8b2e-b7d5a892f70b tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:38.595620 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3af14656-9b39-4f84-8b2e-b7d5a892f70b tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:38.596044 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3af14656-9b39-4f84-8b2e-b7d5a892f70b tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:38.730555 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-3af14656-9b39-4f84-8b2e-b7d5a892f70b tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:22:38.738283 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-3af14656-9b39-4f84-8b2e-b7d5a892f70b tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1575 microversion: 2.1 time: 0.156485 Oct 24 13:22:38.738843 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 517/1007] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:22:38 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:22:39.449729 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-23706c65-8594-4689-bbef-6a00e3d1043f req-afb5e9ef-ad2d-45c1-ac0f-a345bc51c0fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8", "name": "network-vif-unplugged", "status": "completed", "tag": "7ee73beb-73a9-4d41-969d-8ee93d5f0945"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:22:39.461434 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-23706c65-8594-4689-bbef-6a00e3d1043f req-afb5e9ef-ad2d-45c1-ac0f-a345bc51c0fa service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:39.461967 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-23706c65-8594-4689-bbef-6a00e3d1043f req-afb5e9ef-ad2d-45c1-ac0f-a345bc51c0fa service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:39.462327 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-23706c65-8594-4689-bbef-6a00e3d1043f req-afb5e9ef-ad2d-45c1-ac0f-a345bc51c0fa service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:39.475158 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-23706c65-8594-4689-bbef-6a00e3d1043f req-afb5e9ef-ad2d-45c1-ac0f-a345bc51c0fa service nova] Creating event network-vif-unplugged:7ee73beb-73a9-4d41-969d-8ee93d5f0945 for instance 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 on hv-cinder-86248 Oct 24 13:22:39.481425 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-23706c65-8594-4689-bbef-6a00e3d1043f req-afb5e9ef-ad2d-45c1-ac0f-a345bc51c0fa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035374 Oct 24 13:22:39.482297 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 491/1008] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:22:39.762388 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-fcebf862-ec95-490f-b376-4518fbb92a3e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:22:39.763045 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-fcebf862-ec95-490f-b376-4518fbb92a3e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:39.769447 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fcebf862-ec95-490f-b376-4518fbb92a3e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:39.769930 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fcebf862-ec95-490f-b376-4518fbb92a3e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:39.770368 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fcebf862-ec95-490f-b376-4518fbb92a3e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:39.771077 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fcebf862-ec95-490f-b376-4518fbb92a3e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:39.771542 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fcebf862-ec95-490f-b376-4518fbb92a3e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:39.771970 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fcebf862-ec95-490f-b376-4518fbb92a3e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:39.903790 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-fcebf862-ec95-490f-b376-4518fbb92a3e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:22:39.911598 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-fcebf862-ec95-490f-b376-4518fbb92a3e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1575 microversion: 2.1 time: 0.153297 Oct 24 13:22:39.912159 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 518/1009] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:22:39 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:22:40.934963 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-8f8687b7-1236-4ff0-b42f-668560f8c188 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:22:40.935682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-8f8687b7-1236-4ff0-b42f-668560f8c188 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:40.941829 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8f8687b7-1236-4ff0-b42f-668560f8c188 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:40.942306 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8f8687b7-1236-4ff0-b42f-668560f8c188 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:40.942732 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8f8687b7-1236-4ff0-b42f-668560f8c188 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:40.943443 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8f8687b7-1236-4ff0-b42f-668560f8c188 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:40.943999 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8f8687b7-1236-4ff0-b42f-668560f8c188 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:40.944421 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-8f8687b7-1236-4ff0-b42f-668560f8c188 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:41.074261 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-8f8687b7-1236-4ff0-b42f-668560f8c188 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:22:41.082124 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-8f8687b7-1236-4ff0-b42f-668560f8c188 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1575 microversion: 2.1 time: 0.151867 Oct 24 13:22:41.082685 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 492/1010] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:22:40 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:22:42.106182 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-99ee6796-3b3f-4be0-9602-50e1eafd0587 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:22:42.106805 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-99ee6796-3b3f-4be0-9602-50e1eafd0587 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:42.113261 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-99ee6796-3b3f-4be0-9602-50e1eafd0587 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:42.113727 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-99ee6796-3b3f-4be0-9602-50e1eafd0587 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:42.114166 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-99ee6796-3b3f-4be0-9602-50e1eafd0587 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:42.114869 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-99ee6796-3b3f-4be0-9602-50e1eafd0587 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:42.115353 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-99ee6796-3b3f-4be0-9602-50e1eafd0587 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:42.116405 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-99ee6796-3b3f-4be0-9602-50e1eafd0587 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:42.249899 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-99ee6796-3b3f-4be0-9602-50e1eafd0587 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:22:42.257659 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-99ee6796-3b3f-4be0-9602-50e1eafd0587 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1575 microversion: 2.1 time: 0.155350 Oct 24 13:22:42.258261 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 519/1011] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:22:42 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:22:43.292357 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-3cc6f57d-f9a3-4022-9c8d-9f5466cf9989 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:22:43.292962 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-3cc6f57d-f9a3-4022-9c8d-9f5466cf9989 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:43.299350 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3cc6f57d-f9a3-4022-9c8d-9f5466cf9989 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:43.299830 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3cc6f57d-f9a3-4022-9c8d-9f5466cf9989 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:43.300256 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3cc6f57d-f9a3-4022-9c8d-9f5466cf9989 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:43.300931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3cc6f57d-f9a3-4022-9c8d-9f5466cf9989 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:43.301379 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3cc6f57d-f9a3-4022-9c8d-9f5466cf9989 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:43.301792 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3cc6f57d-f9a3-4022-9c8d-9f5466cf9989 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:43.443232 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-3cc6f57d-f9a3-4022-9c8d-9f5466cf9989 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:22:43.451530 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-3cc6f57d-f9a3-4022-9c8d-9f5466cf9989 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1575 microversion: 2.1 time: 0.163141 Oct 24 13:22:43.452098 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 493/1012] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:22:43 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:22:44.474876 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-83aaae5e-33c0-4ce0-9164-559a417168ba tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:22:44.475591 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-83aaae5e-33c0-4ce0-9164-559a417168ba tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:44.482996 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-83aaae5e-33c0-4ce0-9164-559a417168ba tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:44.483582 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-83aaae5e-33c0-4ce0-9164-559a417168ba tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:44.484230 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-83aaae5e-33c0-4ce0-9164-559a417168ba tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:44.485024 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-83aaae5e-33c0-4ce0-9164-559a417168ba tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:44.485554 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-83aaae5e-33c0-4ce0-9164-559a417168ba tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:44.486071 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-83aaae5e-33c0-4ce0-9164-559a417168ba tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:44.620266 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-83aaae5e-33c0-4ce0-9164-559a417168ba tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:22:44.628074 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-83aaae5e-33c0-4ce0-9164-559a417168ba tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1575 microversion: 2.1 time: 0.157229 Oct 24 13:22:44.628632 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 520/1013] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:22:44 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:22:45.652901 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-69b4ba1b-d1eb-40b2-bb30-81b6ab8b9963 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:22:45.653502 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-69b4ba1b-d1eb-40b2-bb30-81b6ab8b9963 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:45.660526 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-69b4ba1b-d1eb-40b2-bb30-81b6ab8b9963 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:45.661379 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-69b4ba1b-d1eb-40b2-bb30-81b6ab8b9963 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:45.661513 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-69b4ba1b-d1eb-40b2-bb30-81b6ab8b9963 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:45.662173 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-69b4ba1b-d1eb-40b2-bb30-81b6ab8b9963 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:45.662622 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-69b4ba1b-d1eb-40b2-bb30-81b6ab8b9963 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:45.663040 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-69b4ba1b-d1eb-40b2-bb30-81b6ab8b9963 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:45.839430 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-69b4ba1b-d1eb-40b2-bb30-81b6ab8b9963 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:22:45.847079 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-69b4ba1b-d1eb-40b2-bb30-81b6ab8b9963 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1575 microversion: 2.1 time: 0.198723 Oct 24 13:22:45.847650 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 494/1014] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:22:45 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1575 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:22:46.871212 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-19f849bb-d834-48aa-8f51-4e90bfc4e74c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:22:46.871777 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-19f849bb-d834-48aa-8f51-4e90bfc4e74c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:46.878231 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19f849bb-d834-48aa-8f51-4e90bfc4e74c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:46.878711 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19f849bb-d834-48aa-8f51-4e90bfc4e74c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:46.879174 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19f849bb-d834-48aa-8f51-4e90bfc4e74c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:46.879863 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19f849bb-d834-48aa-8f51-4e90bfc4e74c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:46.880311 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19f849bb-d834-48aa-8f51-4e90bfc4e74c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:46.880761 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-19f849bb-d834-48aa-8f51-4e90bfc4e74c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:47.022818 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-19f849bb-d834-48aa-8f51-4e90bfc4e74c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:22:47.030771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-19f849bb-d834-48aa-8f51-4e90bfc4e74c tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1575 microversion: 2.1 time: 0.164211 Oct 24 13:22:47.031370 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 521/1015] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:22:46 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:22:48.054904 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-b8cb3321-5ce0-4090-a299-cbb943740dca tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:22:48.055449 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-b8cb3321-5ce0-4090-a299-cbb943740dca tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:22:48.061878 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b8cb3321-5ce0-4090-a299-cbb943740dca tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:48.062402 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b8cb3321-5ce0-4090-a299-cbb943740dca tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:48.062843 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b8cb3321-5ce0-4090-a299-cbb943740dca tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:48.064341 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b8cb3321-5ce0-4090-a299-cbb943740dca tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:48.064975 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b8cb3321-5ce0-4090-a299-cbb943740dca tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:48.065424 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b8cb3321-5ce0-4090-a299-cbb943740dca tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:48.198716 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-b8cb3321-5ce0-4090-a299-cbb943740dca tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:22:48.206646 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-b8cb3321-5ce0-4090-a299-cbb943740dca tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1562 microversion: 2.1 time: 0.155717 Oct 24 13:22:48.207239 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 495/1016] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:22:48 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:22:49.688771 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-f20a57bb-8d99-482a-8a90-95d79cd1c656 req-a25a5991-e202-4a36-826c-627b9efe6ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8", "name": "network-vif-plugged", "status": "completed", "tag": "7ee73beb-73a9-4d41-969d-8ee93d5f0945"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:22:49.699434 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-f20a57bb-8d99-482a-8a90-95d79cd1c656 req-a25a5991-e202-4a36-826c-627b9efe6ea2 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:22:49.699922 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-f20a57bb-8d99-482a-8a90-95d79cd1c656 req-a25a5991-e202-4a36-826c-627b9efe6ea2 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:22:49.700354 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-f20a57bb-8d99-482a-8a90-95d79cd1c656 req-a25a5991-e202-4a36-826c-627b9efe6ea2 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:22:49.712346 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-f20a57bb-8d99-482a-8a90-95d79cd1c656 req-a25a5991-e202-4a36-826c-627b9efe6ea2 service nova] Creating event network-vif-plugged:7ee73beb-73a9-4d41-969d-8ee93d5f0945 for instance 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 on hv-cinder-86248 Oct 24 13:22:49.717598 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-f20a57bb-8d99-482a-8a90-95d79cd1c656 req-a25a5991-e202-4a36-826c-627b9efe6ea2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032396 Oct 24 13:22:49.718214 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 522/1017] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:23:28.263219 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-3d7c2f16-403b-416c-94be-75fcbc7f5cb2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:28.263789 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-3d7c2f16-403b-416c-94be-75fcbc7f5cb2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:23:28.265812 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:SELECT=26 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:28.266467 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:28.274697 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3d7c2f16-403b-416c-94be-75fcbc7f5cb2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:28.275205 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3d7c2f16-403b-416c-94be-75fcbc7f5cb2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:28.275639 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3d7c2f16-403b-416c-94be-75fcbc7f5cb2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:28.276321 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3d7c2f16-403b-416c-94be-75fcbc7f5cb2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:28.276769 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3d7c2f16-403b-416c-94be-75fcbc7f5cb2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:28.277189 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-3d7c2f16-403b-416c-94be-75fcbc7f5cb2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:28.302661 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-3d7c2f16-403b-416c-94be-75fcbc7f5cb2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Going to try to terminate instance {{(pid=118915) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:23:28.385423 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-3d7c2f16-403b-416c-94be-75fcbc7f5cb2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "DELETE /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334" status: 204 len: 0 microversion: 2.1 time: 0.126376 Oct 24 13:23:28.386612 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 496/1018] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:23:28 2022] DELETE /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:23:28.392594 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:28.393439 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:28.397421 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-4dafc6b4-ab78-4f52-a115-53b5fd20bd97 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:28.398675 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-4dafc6b4-ab78-4f52-a115-53b5fd20bd97 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:23:28.406372 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4dafc6b4-ab78-4f52-a115-53b5fd20bd97 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:28.406853 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4dafc6b4-ab78-4f52-a115-53b5fd20bd97 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:28.407313 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4dafc6b4-ab78-4f52-a115-53b5fd20bd97 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:28.408007 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4dafc6b4-ab78-4f52-a115-53b5fd20bd97 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:28.408482 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4dafc6b4-ab78-4f52-a115-53b5fd20bd97 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:28.408905 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4dafc6b4-ab78-4f52-a115-53b5fd20bd97 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:28.540450 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-4dafc6b4-ab78-4f52-a115-53b5fd20bd97 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:23:28.548047 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-4dafc6b4-ab78-4f52-a115-53b5fd20bd97 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334" status: 200 len: 1574 microversion: 2.1 time: 0.157280 Oct 24 13:23:28.548606 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 523/1019] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:23:28 2022] GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:23:29.571636 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-f92d60b1-dc48-44a5-aa7b-5ac392c2f2ce tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:29.572366 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-f92d60b1-dc48-44a5-aa7b-5ac392c2f2ce tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:23:29.578686 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f92d60b1-dc48-44a5-aa7b-5ac392c2f2ce tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:29.579200 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f92d60b1-dc48-44a5-aa7b-5ac392c2f2ce tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:29.579633 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f92d60b1-dc48-44a5-aa7b-5ac392c2f2ce tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:29.580312 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f92d60b1-dc48-44a5-aa7b-5ac392c2f2ce tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:29.580763 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f92d60b1-dc48-44a5-aa7b-5ac392c2f2ce tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:29.581203 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f92d60b1-dc48-44a5-aa7b-5ac392c2f2ce tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:29.714429 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-f92d60b1-dc48-44a5-aa7b-5ac392c2f2ce tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:23:29.722013 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-f92d60b1-dc48-44a5-aa7b-5ac392c2f2ce tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334" status: 200 len: 1574 microversion: 2.1 time: 0.154744 Oct 24 13:23:29.722564 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 497/1020] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:23:29 2022] GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:23:30.745507 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-fb277c9b-50d1-466f-85ed-10ca77aab382 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:30.746189 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-fb277c9b-50d1-466f-85ed-10ca77aab382 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:23:30.756407 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-7a48b863-28bb-4aa8-8505-434212cc665a req-8ef3e2b0-60d0-4ed6-823c-ffcf14aa8827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "540ac816-895b-4737-8d42-9b2c7817f334", "name": "network-vif-deleted", "tag": "6d9a9a89-0d40-45ae-b4f3-42bb1681566f"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:23:30.764465 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fb277c9b-50d1-466f-85ed-10ca77aab382 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:30.765038 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fb277c9b-50d1-466f-85ed-10ca77aab382 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:30.765686 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fb277c9b-50d1-466f-85ed-10ca77aab382 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:30.766459 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-7a48b863-28bb-4aa8-8505-434212cc665a req-8ef3e2b0-60d0-4ed6-823c-ffcf14aa8827 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:30.766591 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fb277c9b-50d1-466f-85ed-10ca77aab382 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:30.766941 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-7a48b863-28bb-4aa8-8505-434212cc665a req-8ef3e2b0-60d0-4ed6-823c-ffcf14aa8827 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:30.767133 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fb277c9b-50d1-466f-85ed-10ca77aab382 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:30.767398 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-7a48b863-28bb-4aa8-8505-434212cc665a req-8ef3e2b0-60d0-4ed6-823c-ffcf14aa8827 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:30.767649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-fb277c9b-50d1-466f-85ed-10ca77aab382 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:30.784189 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-7a48b863-28bb-4aa8-8505-434212cc665a req-8ef3e2b0-60d0-4ed6-823c-ffcf14aa8827 service nova] Creating event network-vif-deleted:6d9a9a89-0d40-45ae-b4f3-42bb1681566f for instance 540ac816-895b-4737-8d42-9b2c7817f334 on hv-cinder-86248 Oct 24 13:23:30.791194 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-7a48b863-28bb-4aa8-8505-434212cc665a req-8ef3e2b0-60d0-4ed6-823c-ffcf14aa8827 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121644 Oct 24 13:23:30.795425 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 524/1021] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:23:30.836122 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-fb277c9b-50d1-466f-85ed-10ca77aab382 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:23:30.844751 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-fb277c9b-50d1-466f-85ed-10ca77aab382 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334" status: 200 len: 1225 microversion: 2.1 time: 0.103920 Oct 24 13:23:30.845331 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 498/1022] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:23:30 2022] GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:23:31.871159 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-b2f9de92-70fc-496b-ad99-4f43bee745f8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:31.871894 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-b2f9de92-70fc-496b-ad99-4f43bee745f8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:23:31.878009 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b2f9de92-70fc-496b-ad99-4f43bee745f8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:31.878495 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b2f9de92-70fc-496b-ad99-4f43bee745f8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:31.878931 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b2f9de92-70fc-496b-ad99-4f43bee745f8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:31.879649 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b2f9de92-70fc-496b-ad99-4f43bee745f8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:31.880105 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b2f9de92-70fc-496b-ad99-4f43bee745f8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:31.880527 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b2f9de92-70fc-496b-ad99-4f43bee745f8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:31.894756 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-b2f9de92-70fc-496b-ad99-4f43bee745f8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] HTTP exception thrown: Instance 540ac816-895b-4737-8d42-9b2c7817f334 could not be found. Oct 24 13:23:31.896526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-b2f9de92-70fc-496b-ad99-4f43bee745f8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Request method failure captured: Oct 24 13:23:31.896526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 HTTP/1.1 Oct 24 13:23:31.896526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:23:31.896526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:23:31.896526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:23:31.896526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:23:31.896526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:23:31.896526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:23:31.896526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:23:31.896526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:23:31.896526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVpEilMaq7mAXZHY4orOYYZmWyICm8ZHjnejcM_953w-RaE7YGocX30NOBhp8jtyJCAyHvKmNnpfTnH1FQ1PV3Ro--_ykDkPAtHFZT6g_IIH_Yt6r2AFI6TxvFSQPYV10WjGOb2Ffc6sSbVPjxu1Awzv4TfPYTIEghsJnziZjbVEWMCw Oct 24 13:23:31.896526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:23:31.896526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:23:31.896526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:23:31.896526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:23:31.896526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:23:31.896526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:23:31.896526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: e5f4729aa5f44fe08096bed3438e8f7e Oct 24 13:23:31.896526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-TestVolumeBootPattern-1997881197 Oct 24 13:23:31.896526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:23:31.896526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:23:31.898893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e5f4729aa5f44fe08096bed3438e8f7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5f4729aa5f44fe08096bed3438e8f7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5f4729aa5f44fe08096bed3438e8f7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e5f4729aa5f44fe08096bed3438e8f7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:23:31.898893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-TestVolumeBootPattern-1997881197 Oct 24 13:23:31.898893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: e5f4729aa5f44fe08096bed3438e8f7e Oct 24 13:23:31.898893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-TestVolumeBootPattern-1997881197 Oct 24 13:23:31.898893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-TestVolumeBootPattern-1997881197-project Oct 24 13:23:31.898893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:23:31.898893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:23:31.898893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: 1fe85edb1188403d84072d19128e07d5 Oct 24 13:23:31.898893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-TestVolumeBootPattern-1997881197-project Oct 24 13:23:31.898893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:23:31.898893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Instance 540ac816-895b-4737-8d42-9b2c7817f334 could not be found. Oct 24 13:23:31.898893 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': '540ac816-895b-4737-8d42-9b2c7817f334'} Oct 24 13:23:31.899948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:23:31.899948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:23:31.899948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:23:31.899948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:23:31.899948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:23:31.899948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:23:31.899948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:23:31.899948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:23:31.899948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:23:31.899948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:23:31.899948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 540ac816-895b-4737-8d42-9b2c7817f334 could not be found. Oct 24 13:23:31.899948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:23:31.899948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:23:31.899948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:23:31.899948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:23:31.899948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:23:31.899948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:23:31.899948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:23:31.899948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:23:31.899948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:23:31.901563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:23:31.901563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:23:31.901563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:23:31.901563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:23:31.901563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:23:31.901563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:23:31.901563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:23:31.901563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 540ac816-895b-4737-8d42-9b2c7817f334 could not be found. Oct 24 13:23:31.901563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:23:31.901563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:23:31.901563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:23:31.901563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:23:31.901563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:23:31.901563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:23:31.901563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:23:31.901563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:23:31.901563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 540ac816-895b-4737-8d42-9b2c7817f334 could not be found. Oct 24 13:23:31.901563 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:23:31.903016 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-b2f9de92-70fc-496b-ad99-4f43bee745f8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Returning 404 to user: Instance 540ac816-895b-4737-8d42-9b2c7817f334 could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:23:31.903016 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-b2f9de92-70fc-496b-ad99-4f43bee745f8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334" status: 404 len: 111 microversion: 2.1 time: 0.031764 Oct 24 13:23:31.903016 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 525/1023] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:23:31 2022] GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:23:31.993884 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-b4b74f85-9908-433e-82e5-109e01b5bd46 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-769595009", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1788078914", "security_groups": [{"name": "tempest-secgroup-smoke-217361373"}], "block_device_mapping_v2": [{"uuid": "b743f732-9f16-4a46-9696-52debaf4f7ab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d81e8b5b-f582-42f2-8207-457fa8977c00"}]}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:23:32.106998 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.network.neutron [None req-b4b74f85-9908-433e-82e5-109e01b5bd46 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] validate_networks() for [('d81e8b5b-f582-42f2-8207-457fa8977c00', None, None, None, None, None)] {{(pid=118915) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:23:32.521179 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-b4b74f85-9908-433e-82e5-109e01b5bd46 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Flavor limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:23:32.521600 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-b4b74f85-9908-433e-82e5-109e01b5bd46 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Image limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:23:32.522072 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-b4b74f85-9908-433e-82e5-109e01b5bd46 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Flavor pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:23:32.522480 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-b4b74f85-9908-433e-82e5-109e01b5bd46 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Image pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:23:32.522919 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-b4b74f85-9908-433e-82e5-109e01b5bd46 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:23:32.531631 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b4b74f85-9908-433e-82e5-109e01b5bd46 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:32.532112 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b4b74f85-9908-433e-82e5-109e01b5bd46 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:32.532571 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b4b74f85-9908-433e-82e5-109e01b5bd46 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:32.533292 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b4b74f85-9908-433e-82e5-109e01b5bd46 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:32.533744 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b4b74f85-9908-433e-82e5-109e01b5bd46 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:32.534166 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-b4b74f85-9908-433e-82e5-109e01b5bd46 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:32.550642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-b4b74f85-9908-433e-82e5-109e01b5bd46 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Getting quotas for project e5f4729aa5f44fe08096bed3438e8f7e. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:23:32.555333 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-b4b74f85-9908-433e-82e5-109e01b5bd46 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Getting quotas for user 1fe85edb1188403d84072d19128e07d5 and project e5f4729aa5f44fe08096bed3438e8f7e. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:23:32.611014 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-b4b74f85-9908-433e-82e5-109e01b5bd46 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Going to run 1 instances... {{(pid=118915) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:23:32.613191 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-b4b74f85-9908-433e-82e5-109e01b5bd46 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 220e25f4-701f-4b80-8dbb-59ccce3aa048] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b743f732-9f16-4a46-9696-52debaf4f7ab',volume_size=None,volume_type=None)] {{(pid=118915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:23:32.743382 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-b4b74f85-9908-433e-82e5-109e01b5bd46 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.753327 Oct 24 13:23:32.744029 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 499/1024] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 24 13:23:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:23:32.755559 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d523af31-d15a-4557-a724-709dc598ec29 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:32.756174 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-d523af31-d15a-4557-a724-709dc598ec29 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 220e25f4-701f-4b80-8dbb-59ccce3aa048] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:23:32.811638 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-d523af31-d15a-4557-a724-709dc598ec29 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:23:32.818629 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-d523af31-d15a-4557-a724-709dc598ec29 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048" status: 200 len: 1094 microversion: 2.1 time: 0.066838 Oct 24 13:23:32.819215 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 526/1025] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:23:32 2022] GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:23:33.843267 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-0f5f7ada-b916-4a1e-abd2-49f95a4d9203 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:33.844022 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-0f5f7ada-b916-4a1e-abd2-49f95a4d9203 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 220e25f4-701f-4b80-8dbb-59ccce3aa048] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:23:33.850489 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f5f7ada-b916-4a1e-abd2-49f95a4d9203 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:33.851005 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f5f7ada-b916-4a1e-abd2-49f95a4d9203 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:33.851472 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f5f7ada-b916-4a1e-abd2-49f95a4d9203 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:33.852172 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f5f7ada-b916-4a1e-abd2-49f95a4d9203 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:33.852631 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f5f7ada-b916-4a1e-abd2-49f95a4d9203 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:33.853057 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-0f5f7ada-b916-4a1e-abd2-49f95a4d9203 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:33.927233 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-0f5f7ada-b916-4a1e-abd2-49f95a4d9203 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:23:33.949047 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-0f5f7ada-b916-4a1e-abd2-49f95a4d9203 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048" status: 200 len: 1200 microversion: 2.1 time: 0.109591 Oct 24 13:23:33.949644 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 500/1026] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:23:33 2022] GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048 => generated 1200 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:23:34.975191 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-4287b444-50e4-477a-a5bb-870f114cac1c tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:34.976281 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-4287b444-50e4-477a-a5bb-870f114cac1c tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 220e25f4-701f-4b80-8dbb-59ccce3aa048] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:23:34.983871 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4287b444-50e4-477a-a5bb-870f114cac1c tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:34.985039 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4287b444-50e4-477a-a5bb-870f114cac1c tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:34.985246 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4287b444-50e4-477a-a5bb-870f114cac1c tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:34.985938 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4287b444-50e4-477a-a5bb-870f114cac1c tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:34.986386 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4287b444-50e4-477a-a5bb-870f114cac1c tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:34.986974 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-4287b444-50e4-477a-a5bb-870f114cac1c tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:35.128199 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-4287b444-50e4-477a-a5bb-870f114cac1c tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:23:35.137295 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-4287b444-50e4-477a-a5bb-870f114cac1c tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048" status: 200 len: 1265 microversion: 2.1 time: 0.165961 Oct 24 13:23:35.137927 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 527/1027] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:23:34 2022] GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:23:35.511380 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-88376ecd-b18e-4f58-a83e-8facb62a385d req-aaa869f9-3176-4cd2-8d41-c97255c73373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "220e25f4-701f-4b80-8dbb-59ccce3aa048", "tag": "749b73b0-1746-43c7-ab4e-7e32756bfd58"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:23:35.521562 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-88376ecd-b18e-4f58-a83e-8facb62a385d req-aaa869f9-3176-4cd2-8d41-c97255c73373 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:35.522183 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-88376ecd-b18e-4f58-a83e-8facb62a385d req-aaa869f9-3176-4cd2-8d41-c97255c73373 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:35.523457 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-88376ecd-b18e-4f58-a83e-8facb62a385d req-aaa869f9-3176-4cd2-8d41-c97255c73373 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:35.534834 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-88376ecd-b18e-4f58-a83e-8facb62a385d req-aaa869f9-3176-4cd2-8d41-c97255c73373 service nova] Creating event network-changed:749b73b0-1746-43c7-ab4e-7e32756bfd58 for instance 220e25f4-701f-4b80-8dbb-59ccce3aa048 on hv-cinder-86248 Oct 24 13:23:35.541091 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-88376ecd-b18e-4f58-a83e-8facb62a385d req-aaa869f9-3176-4cd2-8d41-c97255c73373 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033439 Oct 24 13:23:35.541907 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 501/1028] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:23:36.161267 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-7d3d6672-b8c9-440c-8faf-1d329549b552 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:36.161983 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-7d3d6672-b8c9-440c-8faf-1d329549b552 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 220e25f4-701f-4b80-8dbb-59ccce3aa048] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:23:36.168478 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7d3d6672-b8c9-440c-8faf-1d329549b552 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:36.169043 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7d3d6672-b8c9-440c-8faf-1d329549b552 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:36.169551 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7d3d6672-b8c9-440c-8faf-1d329549b552 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:36.170252 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7d3d6672-b8c9-440c-8faf-1d329549b552 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:36.170709 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7d3d6672-b8c9-440c-8faf-1d329549b552 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:36.171158 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-7d3d6672-b8c9-440c-8faf-1d329549b552 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:36.303033 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-7d3d6672-b8c9-440c-8faf-1d329549b552 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:23:36.315418 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-7d3d6672-b8c9-440c-8faf-1d329549b552 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048" status: 200 len: 1265 microversion: 2.1 time: 0.158100 Oct 24 13:23:36.316003 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 528/1029] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:23:36 2022] GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:23:37.341351 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-e6e5de3f-3e28-40ba-a1d8-48f1f8a59a8e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:37.342061 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-e6e5de3f-3e28-40ba-a1d8-48f1f8a59a8e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 220e25f4-701f-4b80-8dbb-59ccce3aa048] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:23:37.348207 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e6e5de3f-3e28-40ba-a1d8-48f1f8a59a8e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:37.348685 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e6e5de3f-3e28-40ba-a1d8-48f1f8a59a8e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:37.349119 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e6e5de3f-3e28-40ba-a1d8-48f1f8a59a8e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:37.349800 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e6e5de3f-3e28-40ba-a1d8-48f1f8a59a8e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:37.350274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e6e5de3f-3e28-40ba-a1d8-48f1f8a59a8e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:37.350679 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e6e5de3f-3e28-40ba-a1d8-48f1f8a59a8e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:37.487423 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-e6e5de3f-3e28-40ba-a1d8-48f1f8a59a8e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:23:37.495075 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-e6e5de3f-3e28-40ba-a1d8-48f1f8a59a8e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048" status: 200 len: 1265 microversion: 2.1 time: 0.158381 Oct 24 13:23:37.495650 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 502/1030] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:23:37 2022] GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:23:38.519261 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-a10879f1-3a2c-4244-b7d2-1a7fe53ed46d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:38.519875 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-a10879f1-3a2c-4244-b7d2-1a7fe53ed46d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 220e25f4-701f-4b80-8dbb-59ccce3aa048] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:23:38.527173 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a10879f1-3a2c-4244-b7d2-1a7fe53ed46d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:38.527655 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a10879f1-3a2c-4244-b7d2-1a7fe53ed46d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:38.528087 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a10879f1-3a2c-4244-b7d2-1a7fe53ed46d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:38.528774 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a10879f1-3a2c-4244-b7d2-1a7fe53ed46d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:38.529226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a10879f1-3a2c-4244-b7d2-1a7fe53ed46d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:38.529647 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-a10879f1-3a2c-4244-b7d2-1a7fe53ed46d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:38.664178 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-a10879f1-3a2c-4244-b7d2-1a7fe53ed46d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:23:38.671830 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-a10879f1-3a2c-4244-b7d2-1a7fe53ed46d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048" status: 200 len: 1265 microversion: 2.1 time: 0.156757 Oct 24 13:23:38.672393 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 529/1031] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:23:38 2022] GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:23:39.694400 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-f575c4e8-667b-438a-b8fa-85457aa09da0 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:39.695024 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-f575c4e8-667b-438a-b8fa-85457aa09da0 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 220e25f4-701f-4b80-8dbb-59ccce3aa048] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:23:39.701461 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f575c4e8-667b-438a-b8fa-85457aa09da0 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:39.701939 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f575c4e8-667b-438a-b8fa-85457aa09da0 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:39.702369 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f575c4e8-667b-438a-b8fa-85457aa09da0 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:39.703075 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f575c4e8-667b-438a-b8fa-85457aa09da0 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:39.703532 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f575c4e8-667b-438a-b8fa-85457aa09da0 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:39.703955 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-f575c4e8-667b-438a-b8fa-85457aa09da0 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:39.832727 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-f575c4e8-667b-438a-b8fa-85457aa09da0 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:23:39.841157 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-f575c4e8-667b-438a-b8fa-85457aa09da0 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048" status: 200 len: 1265 microversion: 2.1 time: 0.150660 Oct 24 13:23:39.841710 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 503/1032] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:23:39 2022] GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:23:40.864164 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-bb25ddf0-7ca5-4aba-b119-62f2f5425476 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:40.864775 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-bb25ddf0-7ca5-4aba-b119-62f2f5425476 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 220e25f4-701f-4b80-8dbb-59ccce3aa048] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:23:40.871891 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bb25ddf0-7ca5-4aba-b119-62f2f5425476 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:40.872372 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bb25ddf0-7ca5-4aba-b119-62f2f5425476 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:40.872803 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bb25ddf0-7ca5-4aba-b119-62f2f5425476 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:40.873489 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bb25ddf0-7ca5-4aba-b119-62f2f5425476 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:40.873951 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bb25ddf0-7ca5-4aba-b119-62f2f5425476 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:40.874373 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-bb25ddf0-7ca5-4aba-b119-62f2f5425476 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:41.005751 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-bb25ddf0-7ca5-4aba-b119-62f2f5425476 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:23:41.013920 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-bb25ddf0-7ca5-4aba-b119-62f2f5425476 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048" status: 200 len: 1265 microversion: 2.1 time: 0.153655 Oct 24 13:23:41.014488 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 530/1033] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:23:40 2022] GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:23:42.036672 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-80ae3868-b863-492a-9e35-97ac84421058 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:42.037281 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-80ae3868-b863-492a-9e35-97ac84421058 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 220e25f4-701f-4b80-8dbb-59ccce3aa048] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:23:42.043873 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-80ae3868-b863-492a-9e35-97ac84421058 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:42.044360 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-80ae3868-b863-492a-9e35-97ac84421058 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:42.044777 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-80ae3868-b863-492a-9e35-97ac84421058 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:42.045456 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-80ae3868-b863-492a-9e35-97ac84421058 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:42.045903 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-80ae3868-b863-492a-9e35-97ac84421058 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:42.046317 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-80ae3868-b863-492a-9e35-97ac84421058 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:42.179074 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-80ae3868-b863-492a-9e35-97ac84421058 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:23:42.186632 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-80ae3868-b863-492a-9e35-97ac84421058 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048" status: 200 len: 1265 microversion: 2.1 time: 0.153842 Oct 24 13:23:42.187209 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 504/1034] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:23:42 2022] GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:23:43.210495 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-b17b7a68-d430-44b9-aeef-e4c53332c4f2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:43.211239 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-b17b7a68-d430-44b9-aeef-e4c53332c4f2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 220e25f4-701f-4b80-8dbb-59ccce3aa048] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:23:43.213641 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=2 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:43.218825 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b17b7a68-d430-44b9-aeef-e4c53332c4f2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:43.219340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b17b7a68-d430-44b9-aeef-e4c53332c4f2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:43.219778 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b17b7a68-d430-44b9-aeef-e4c53332c4f2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:43.220463 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b17b7a68-d430-44b9-aeef-e4c53332c4f2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:43.220917 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b17b7a68-d430-44b9-aeef-e4c53332c4f2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:43.221340 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-b17b7a68-d430-44b9-aeef-e4c53332c4f2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:43.357167 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-b17b7a68-d430-44b9-aeef-e4c53332c4f2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:23:43.364846 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-b17b7a68-d430-44b9-aeef-e4c53332c4f2 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048" status: 200 len: 1265 microversion: 2.1 time: 0.158905 Oct 24 13:23:43.365406 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 531/1035] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:23:43 2022] GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:23:44.387211 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-090efb56-f9e3-46d6-8331-eee048699ba4 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:44.387827 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-090efb56-f9e3-46d6-8331-eee048699ba4 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 220e25f4-701f-4b80-8dbb-59ccce3aa048] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:23:44.392764 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=2 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:44.393413 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=6 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:23:44.395871 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-090efb56-f9e3-46d6-8331-eee048699ba4 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:44.396386 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-090efb56-f9e3-46d6-8331-eee048699ba4 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:44.396817 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-090efb56-f9e3-46d6-8331-eee048699ba4 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:44.397511 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-090efb56-f9e3-46d6-8331-eee048699ba4 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:44.397960 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-090efb56-f9e3-46d6-8331-eee048699ba4 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:44.398872 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-090efb56-f9e3-46d6-8331-eee048699ba4 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:44.534337 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-090efb56-f9e3-46d6-8331-eee048699ba4 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:23:44.542886 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-090efb56-f9e3-46d6-8331-eee048699ba4 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048" status: 200 len: 1265 microversion: 2.1 time: 0.159854 Oct 24 13:23:44.543476 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 505/1036] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:23:44 2022] GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:23:45.565707 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-deb1a6b7-8785-4b50-8815-3ce6387e1c2f tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:45.566320 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-deb1a6b7-8785-4b50-8815-3ce6387e1c2f tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 220e25f4-701f-4b80-8dbb-59ccce3aa048] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:23:45.572199 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-deb1a6b7-8785-4b50-8815-3ce6387e1c2f tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:45.572679 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-deb1a6b7-8785-4b50-8815-3ce6387e1c2f tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:45.573111 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-deb1a6b7-8785-4b50-8815-3ce6387e1c2f tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:45.573825 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-deb1a6b7-8785-4b50-8815-3ce6387e1c2f tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:45.574276 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-deb1a6b7-8785-4b50-8815-3ce6387e1c2f tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:45.574699 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-deb1a6b7-8785-4b50-8815-3ce6387e1c2f tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:45.708736 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-deb1a6b7-8785-4b50-8815-3ce6387e1c2f tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:23:45.716471 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-deb1a6b7-8785-4b50-8815-3ce6387e1c2f tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048" status: 200 len: 1265 microversion: 2.1 time: 0.154800 Oct 24 13:23:45.717028 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 532/1037] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:23:45 2022] GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:23:45.963447 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-f703eb7d-51c2-4a9e-8cce-0e9e0fe6b11f req-dd1afdf1-66e3-459d-9e0f-183bc4d092b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "220e25f4-701f-4b80-8dbb-59ccce3aa048", "name": "network-vif-plugged", "status": "completed", "tag": "749b73b0-1746-43c7-ab4e-7e32756bfd58"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:23:45.972708 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-f703eb7d-51c2-4a9e-8cce-0e9e0fe6b11f req-dd1afdf1-66e3-459d-9e0f-183bc4d092b7 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:45.973190 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-f703eb7d-51c2-4a9e-8cce-0e9e0fe6b11f req-dd1afdf1-66e3-459d-9e0f-183bc4d092b7 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:45.973611 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-f703eb7d-51c2-4a9e-8cce-0e9e0fe6b11f req-dd1afdf1-66e3-459d-9e0f-183bc4d092b7 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:45.985937 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-f703eb7d-51c2-4a9e-8cce-0e9e0fe6b11f req-dd1afdf1-66e3-459d-9e0f-183bc4d092b7 service nova] Creating event network-vif-plugged:749b73b0-1746-43c7-ab4e-7e32756bfd58 for instance 220e25f4-701f-4b80-8dbb-59ccce3aa048 on hv-cinder-86248 Oct 24 13:23:45.990768 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-f703eb7d-51c2-4a9e-8cce-0e9e0fe6b11f req-dd1afdf1-66e3-459d-9e0f-183bc4d092b7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095157 Oct 24 13:23:45.991391 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 506/1038] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:23:46.739526 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-594366a7-276f-4362-911d-d1a881b58613 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:46.740148 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-594366a7-276f-4362-911d-d1a881b58613 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 220e25f4-701f-4b80-8dbb-59ccce3aa048] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:23:46.747428 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-594366a7-276f-4362-911d-d1a881b58613 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:46.747923 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-594366a7-276f-4362-911d-d1a881b58613 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:46.748361 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-594366a7-276f-4362-911d-d1a881b58613 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:46.749061 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-594366a7-276f-4362-911d-d1a881b58613 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:46.749551 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-594366a7-276f-4362-911d-d1a881b58613 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:46.749989 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-594366a7-276f-4362-911d-d1a881b58613 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:46.881266 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-594366a7-276f-4362-911d-d1a881b58613 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:23:46.889838 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-594366a7-276f-4362-911d-d1a881b58613 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048" status: 200 len: 1265 microversion: 2.1 time: 0.154168 Oct 24 13:23:46.890400 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 533/1039] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:23:46 2022] GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:23:47.913357 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-2c022e04-7f53-489b-8d4b-e4d3b33c221a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:47.914216 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-2c022e04-7f53-489b-8d4b-e4d3b33c221a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 220e25f4-701f-4b80-8dbb-59ccce3aa048] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:23:47.920329 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c022e04-7f53-489b-8d4b-e4d3b33c221a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:47.920805 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c022e04-7f53-489b-8d4b-e4d3b33c221a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:47.921237 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c022e04-7f53-489b-8d4b-e4d3b33c221a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:47.921920 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c022e04-7f53-489b-8d4b-e4d3b33c221a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:47.922372 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c022e04-7f53-489b-8d4b-e4d3b33c221a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:47.922795 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2c022e04-7f53-489b-8d4b-e4d3b33c221a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:48.056164 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-2c022e04-7f53-489b-8d4b-e4d3b33c221a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:23:48.063866 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-2c022e04-7f53-489b-8d4b-e4d3b33c221a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048" status: 200 len: 1451 microversion: 2.1 time: 0.155168 Oct 24 13:23:48.064428 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 507/1040] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:23:47 2022] GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:23:48.086582 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-499c9d03-8570-44e7-8718-f148536d97ce tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:23:48.087234 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-499c9d03-8570-44e7-8718-f148536d97ce tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 220e25f4-701f-4b80-8dbb-59ccce3aa048] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:23:48.093716 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-499c9d03-8570-44e7-8718-f148536d97ce tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:48.094197 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-499c9d03-8570-44e7-8718-f148536d97ce tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:48.094635 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-499c9d03-8570-44e7-8718-f148536d97ce tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:48.095349 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-499c9d03-8570-44e7-8718-f148536d97ce tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:48.095810 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-499c9d03-8570-44e7-8718-f148536d97ce tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:48.096243 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-499c9d03-8570-44e7-8718-f148536d97ce tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:48.230361 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-499c9d03-8570-44e7-8718-f148536d97ce tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:23:48.237953 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-499c9d03-8570-44e7-8718-f148536d97ce tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048" status: 200 len: 1451 microversion: 2.1 time: 0.155227 Oct 24 13:23:48.238507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 534/1041] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:23:48 2022] GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:23:49.874243 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-6674c4de-b348-42b9-94f0-90abc11b6e98 req-4eb8b956-0b7c-47f1-a177-f7d40f636683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "220e25f4-701f-4b80-8dbb-59ccce3aa048", "tag": "749b73b0-1746-43c7-ab4e-7e32756bfd58"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:23:49.884148 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-6674c4de-b348-42b9-94f0-90abc11b6e98 req-4eb8b956-0b7c-47f1-a177-f7d40f636683 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:23:49.884629 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-6674c4de-b348-42b9-94f0-90abc11b6e98 req-4eb8b956-0b7c-47f1-a177-f7d40f636683 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:23:49.885060 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-6674c4de-b348-42b9-94f0-90abc11b6e98 req-4eb8b956-0b7c-47f1-a177-f7d40f636683 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:23:49.897449 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-6674c4de-b348-42b9-94f0-90abc11b6e98 req-4eb8b956-0b7c-47f1-a177-f7d40f636683 service nova] Creating event network-changed:749b73b0-1746-43c7-ab4e-7e32756bfd58 for instance 220e25f4-701f-4b80-8dbb-59ccce3aa048 on hv-cinder-86248 Oct 24 13:23:49.903370 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-6674c4de-b348-42b9-94f0-90abc11b6e98 req-4eb8b956-0b7c-47f1-a177-f7d40f636683 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091678 Oct 24 13:23:49.904056 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 508/1042] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:24:05.123586 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-cb5a2730-7380-412d-abaf-fcdc05992715 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:24:05.124116 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:24:05.124485 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-cb5a2730-7380-412d-abaf-fcdc05992715 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:24:05.124962 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:24:05.126679 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=26 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:24:05.127432 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=58 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:24:05.129093 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-4f7a12d9-ef75-478d-a30e-5060c1e78e3d req-19129617-89a5-49a4-a472-753af15e8689 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8", "tag": "7ee73beb-73a9-4d41-969d-8ee93d5f0945"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:24:05.138723 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cb5a2730-7380-412d-abaf-fcdc05992715 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:24:05.139308 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cb5a2730-7380-412d-abaf-fcdc05992715 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:24:05.139744 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cb5a2730-7380-412d-abaf-fcdc05992715 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:24:05.140447 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cb5a2730-7380-412d-abaf-fcdc05992715 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:24:05.140898 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cb5a2730-7380-412d-abaf-fcdc05992715 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:24:05.141150 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-4f7a12d9-ef75-478d-a30e-5060c1e78e3d req-19129617-89a5-49a4-a472-753af15e8689 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:24:05.141315 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-cb5a2730-7380-412d-abaf-fcdc05992715 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:24:05.141627 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-4f7a12d9-ef75-478d-a30e-5060c1e78e3d req-19129617-89a5-49a4-a472-753af15e8689 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:24:05.142051 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-4f7a12d9-ef75-478d-a30e-5060c1e78e3d req-19129617-89a5-49a4-a472-753af15e8689 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:24:05.155496 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-4f7a12d9-ef75-478d-a30e-5060c1e78e3d req-19129617-89a5-49a4-a472-753af15e8689 service nova] Creating event network-changed:7ee73beb-73a9-4d41-969d-8ee93d5f0945 for instance 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 on hv-cinder-86248 Oct 24 13:24:05.160725 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-4f7a12d9-ef75-478d-a30e-5060c1e78e3d req-19129617-89a5-49a4-a472-753af15e8689 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038066 Oct 24 13:24:05.161321 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 509/1043] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:24:05.174980 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-cb5a2730-7380-412d-abaf-fcdc05992715 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Going to try to terminate instance {{(pid=118914) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:24:05.260571 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-cb5a2730-7380-412d-abaf-fcdc05992715 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 204 len: 0 microversion: 2.1 time: 0.140157 Oct 24 13:24:05.262345 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 535/1044] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:24:05 2022] DELETE /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:24:05.273416 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-91206b26-c431-4e9b-ac2f-1ab1b16af18d tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:24:05.274262 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-91206b26-c431-4e9b-ac2f-1ab1b16af18d tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:24:05.281852 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-91206b26-c431-4e9b-ac2f-1ab1b16af18d tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:24:05.282347 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-91206b26-c431-4e9b-ac2f-1ab1b16af18d tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:24:05.282778 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-91206b26-c431-4e9b-ac2f-1ab1b16af18d tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:24:05.283515 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-91206b26-c431-4e9b-ac2f-1ab1b16af18d tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:24:05.283973 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-91206b26-c431-4e9b-ac2f-1ab1b16af18d tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:24:05.284397 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-91206b26-c431-4e9b-ac2f-1ab1b16af18d tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:24:05.449457 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-91206b26-c431-4e9b-ac2f-1ab1b16af18d tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:24:05.457230 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-91206b26-c431-4e9b-ac2f-1ab1b16af18d tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1568 microversion: 2.1 time: 0.190407 Oct 24 13:24:05.458042 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 510/1045] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:24:05 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:24:06.480942 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-0e8b2c72-7b94-4111-82c0-2de3d71fcc1e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:24:06.481640 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-0e8b2c72-7b94-4111-82c0-2de3d71fcc1e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:24:06.487969 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0e8b2c72-7b94-4111-82c0-2de3d71fcc1e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:24:06.488445 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0e8b2c72-7b94-4111-82c0-2de3d71fcc1e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:24:06.488877 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0e8b2c72-7b94-4111-82c0-2de3d71fcc1e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:24:06.489559 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0e8b2c72-7b94-4111-82c0-2de3d71fcc1e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:24:06.490008 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0e8b2c72-7b94-4111-82c0-2de3d71fcc1e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:24:06.490426 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-0e8b2c72-7b94-4111-82c0-2de3d71fcc1e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:24:06.629636 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-0e8b2c72-7b94-4111-82c0-2de3d71fcc1e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:24:06.638063 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-0e8b2c72-7b94-4111-82c0-2de3d71fcc1e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1568 microversion: 2.1 time: 0.161367 Oct 24 13:24:06.638647 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 536/1046] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:24:06 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:24:07.284842 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-0bb96549-753f-4daf-bb50-184f3c8d11ed req-4c511f82-e1b4-487e-9063-60b935cf7ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8", "name": "network-vif-deleted", "tag": "7ee73beb-73a9-4d41-969d-8ee93d5f0945"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:24:07.295867 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-0bb96549-753f-4daf-bb50-184f3c8d11ed req-4c511f82-e1b4-487e-9063-60b935cf7ba0 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:24:07.296347 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-0bb96549-753f-4daf-bb50-184f3c8d11ed req-4c511f82-e1b4-487e-9063-60b935cf7ba0 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:24:07.296777 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-0bb96549-753f-4daf-bb50-184f3c8d11ed req-4c511f82-e1b4-487e-9063-60b935cf7ba0 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:24:07.308828 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-0bb96549-753f-4daf-bb50-184f3c8d11ed req-4c511f82-e1b4-487e-9063-60b935cf7ba0 service nova] Creating event network-vif-deleted:7ee73beb-73a9-4d41-969d-8ee93d5f0945 for instance 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 on hv-cinder-86248 Oct 24 13:24:07.313603 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-0bb96549-753f-4daf-bb50-184f3c8d11ed req-4c511f82-e1b4-487e-9063-60b935cf7ba0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032395 Oct 24 13:24:07.314206 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 511/1047] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:24:07.661783 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-1d176ba1-aa9b-4e5c-98d4-0634d10626e4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:24:07.662404 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-1d176ba1-aa9b-4e5c-98d4-0634d10626e4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:24:07.670163 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1d176ba1-aa9b-4e5c-98d4-0634d10626e4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:24:07.670870 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1d176ba1-aa9b-4e5c-98d4-0634d10626e4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:24:07.671519 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1d176ba1-aa9b-4e5c-98d4-0634d10626e4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:24:07.672518 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1d176ba1-aa9b-4e5c-98d4-0634d10626e4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:24:07.673065 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1d176ba1-aa9b-4e5c-98d4-0634d10626e4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:24:07.673689 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1d176ba1-aa9b-4e5c-98d4-0634d10626e4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:24:07.712167 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1d176ba1-aa9b-4e5c-98d4-0634d10626e4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:24:07.712775 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1d176ba1-aa9b-4e5c-98d4-0634d10626e4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:24:07.713386 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1d176ba1-aa9b-4e5c-98d4-0634d10626e4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:24:07.713960 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.objects.instance [None req-1d176ba1-aa9b-4e5c-98d4-0634d10626e4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lazy-loading 'fault' on Instance uuid 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 {{(pid=118914) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:24:07.758216 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-1d176ba1-aa9b-4e5c-98d4-0634d10626e4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af98e8f344914ae59852d82d176b4dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bee9967bdb41eca0acff51d5e105e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:24:07.766586 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-1d176ba1-aa9b-4e5c-98d4-0634d10626e4 tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 200 len: 1225 microversion: 2.1 time: 0.108781 Oct 24 13:24:07.767182 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 537/1048] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:24:07 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:24:08.792284 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-a106dba6-fc25-4ed1-b9ad-2dfeecc74d8f tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:24:08.792993 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-a106dba6-fc25-4ed1-b9ad-2dfeecc74d8f tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] [instance: 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:24:08.799075 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a106dba6-fc25-4ed1-b9ad-2dfeecc74d8f tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:24:08.799576 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a106dba6-fc25-4ed1-b9ad-2dfeecc74d8f tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:24:08.800005 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a106dba6-fc25-4ed1-b9ad-2dfeecc74d8f tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:24:08.800694 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a106dba6-fc25-4ed1-b9ad-2dfeecc74d8f tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:24:08.801146 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a106dba6-fc25-4ed1-b9ad-2dfeecc74d8f tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:24:08.801570 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a106dba6-fc25-4ed1-b9ad-2dfeecc74d8f tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:24:08.814714 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-a106dba6-fc25-4ed1-b9ad-2dfeecc74d8f tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] HTTP exception thrown: Instance 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 could not be found. Oct 24 13:24:08.816328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-a106dba6-fc25-4ed1-b9ad-2dfeecc74d8f tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Request method failure captured: Oct 24 13:24:08.816328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 HTTP/1.1 Oct 24 13:24:08.816328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:24:08.816328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:24:08.816328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:24:08.816328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:24:08.816328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:24:08.816328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:24:08.816328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:24:08.816328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:24:08.816328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVpDZU6wGarnJJNPlWgIM48K9ZDRmATq88Rs2N_0jXNGPsCOZoEcq9tckbjzGhqCG4OXkJpKxmKrIH1JQT6nv6lA4zz2dltTzHeSGNI8ZrhVTpGzrVvHRwar6yNwnxl9VJBXe3TROx64zyO2gr_tGZbOrWRM0UY-G6qGwoQZojeQy7Ns Oct 24 13:24:08.816328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:24:08.816328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:24:08.816328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:24:08.816328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:24:08.816328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:24:08.816328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:24:08.816328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: f0bee9967bdb41eca0acff51d5e105e9 Oct 24 13:24:08.816328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-TestShelveInstance-1487450295 Oct 24 13:24:08.816328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:24:08.816328 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:24:08.818110 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f0bee9967bdb41eca0acff51d5e105e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f0bee9967bdb41eca0acff51d5e105e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f0bee9967bdb41eca0acff51d5e105e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f0bee9967bdb41eca0acff51d5e105e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:24:08.818110 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-TestShelveInstance-1487450295 Oct 24 13:24:08.818110 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: f0bee9967bdb41eca0acff51d5e105e9 Oct 24 13:24:08.818110 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-TestShelveInstance-1487450295 Oct 24 13:24:08.818110 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-TestShelveInstance-1487450295-project Oct 24 13:24:08.818110 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:24:08.818110 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:24:08.818110 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: af98e8f344914ae59852d82d176b4dc2 Oct 24 13:24:08.818110 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-TestShelveInstance-1487450295-project Oct 24 13:24:08.818110 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:24:08.818110 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Instance 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 could not be found. Oct 24 13:24:08.818110 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': '6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8'} Oct 24 13:24:08.819225 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:24:08.819225 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:24:08.819225 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:24:08.819225 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:24:08.819225 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:24:08.819225 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:24:08.819225 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:24:08.819225 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:24:08.819225 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:24:08.819225 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:24:08.819225 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 could not be found. Oct 24 13:24:08.819225 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:24:08.819225 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:24:08.819225 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:24:08.819225 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:24:08.819225 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:24:08.819225 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:24:08.819225 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:24:08.819225 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:24:08.819225 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:24:08.821099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:24:08.821099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:24:08.821099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:24:08.821099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:24:08.821099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:24:08.821099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:24:08.821099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:24:08.821099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 could not be found. Oct 24 13:24:08.821099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:24:08.821099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:24:08.821099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:24:08.821099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:24:08.821099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:24:08.821099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:24:08.821099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:24:08.821099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:24:08.821099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 could not be found. Oct 24 13:24:08.821099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:24:08.822648 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-a106dba6-fc25-4ed1-b9ad-2dfeecc74d8f tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Returning 404 to user: Instance 6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:24:08.822648 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-a106dba6-fc25-4ed1-b9ad-2dfeecc74d8f tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8" status: 404 len: 111 microversion: 2.1 time: 0.030808 Oct 24 13:24:08.822648 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 512/1049] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:24:08 2022] GET /compute/v2.1/servers/6d3760a5-8a89-4c4a-9fcb-2cf98679a0d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:24:08.989767 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-fc21ceba-7ba9-41b8-9c7e-7f68acf02f8e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] Calling method '.version_select at 0x7fad28613040>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:24:09.011858 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-fc21ceba-7ba9-41b8-9c7e-7f68acf02f8e tempest-TestShelveInstance-1487450295 tempest-TestShelveInstance-1487450295-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1444731753" status: 202 len: 0 microversion: 2.1 time: 0.026005 Oct 24 13:24:09.012764 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 538/1050] 10.222.0.42 () {58 vars in 1254 bytes} [Mon Oct 24 13:24:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1444731753 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 24 13:25:23.150270 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:SELECT=8 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:23.151037 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=12 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:23.152588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 13:25:23.153380 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Mon Oct 24 13:25:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Oct 24 13:25:23.158043 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-ef5e4713-a889-47a8-a98c-6de521a542d8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-646032849", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1788078914", "security_groups": [{"name": "tempest-secgroup-smoke-217361373"}], "block_device_mapping_v2": [{"uuid": "fbb32f3e-0fab-48bd-bdcc-d90b88917b1c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d81e8b5b-f582-42f2-8207-457fa8977c00"}]}} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:25:23.274668 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.network.neutron [None req-ef5e4713-a889-47a8-a98c-6de521a542d8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] validate_networks() for [('d81e8b5b-f582-42f2-8207-457fa8977c00', None, None, None, None, None)] {{(pid=118915) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 24 13:25:23.639900 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-ef5e4713-a889-47a8-a98c-6de521a542d8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Flavor limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 24 13:25:23.640317 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-ef5e4713-a889-47a8-a98c-6de521a542d8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Image limits 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 24 13:25:23.640783 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-ef5e4713-a889-47a8-a98c-6de521a542d8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Flavor pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 24 13:25:23.641213 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-ef5e4713-a889-47a8-a98c-6de521a542d8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Image pref 0:0:0 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 24 13:25:23.641619 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.virt.hardware [None req-ef5e4713-a889-47a8-a98c-6de521a542d8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118915) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 24 13:25:23.650199 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ef5e4713-a889-47a8-a98c-6de521a542d8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:23.650671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ef5e4713-a889-47a8-a98c-6de521a542d8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:23.651137 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ef5e4713-a889-47a8-a98c-6de521a542d8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:23.651852 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ef5e4713-a889-47a8-a98c-6de521a542d8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:23.652300 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ef5e4713-a889-47a8-a98c-6de521a542d8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:23.652762 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ef5e4713-a889-47a8-a98c-6de521a542d8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:23.670170 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-ef5e4713-a889-47a8-a98c-6de521a542d8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Getting quotas for project e5f4729aa5f44fe08096bed3438e8f7e. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 24 13:25:23.673944 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.quota [None req-ef5e4713-a889-47a8-a98c-6de521a542d8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Getting quotas for user 1fe85edb1188403d84072d19128e07d5 and project e5f4729aa5f44fe08096bed3438e8f7e. Resources: {'cores', 'instances', 'ram'} {{(pid=118915) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 24 13:25:23.730285 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-ef5e4713-a889-47a8-a98c-6de521a542d8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Going to run 1 instances... {{(pid=118915) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 24 13:25:23.733415 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-ef5e4713-a889-47a8-a98c-6de521a542d8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 5ea7170c-6ab9-47d4-9a96-4629eb32ad88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fbb32f3e-0fab-48bd-bdcc-d90b88917b1c',volume_size=None,volume_type=None)] {{(pid=118915) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 24 13:25:23.862106 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-ef5e4713-a889-47a8-a98c-6de521a542d8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.713475 Oct 24 13:25:23.862791 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 513/1051] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Oct 24 13:25:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 24 13:25:23.873707 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:23.874524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:23.875955 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 13:25:23.876124 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Mon Oct 24 13:25:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88 (ip 10.222.0.42) !!! Oct 24 13:25:23.882794 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-3f93f1b7-b48a-4880-b5c8-b292947b5304 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:23.883705 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-3f93f1b7-b48a-4880-b5c8-b292947b5304 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 5ea7170c-6ab9-47d4-9a96-4629eb32ad88] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:23.946441 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-3f93f1b7-b48a-4880-b5c8-b292947b5304 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:23.953914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-3f93f1b7-b48a-4880-b5c8-b292947b5304 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88" status: 200 len: 1094 microversion: 2.1 time: 0.083763 Oct 24 13:25:23.954578 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 539/1052] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:23 2022] GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88 => generated 1094 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:24.978003 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9e577500-f63d-4b11-bc34-686753681948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:24.978629 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9e577500-f63d-4b11-bc34-686753681948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 5ea7170c-6ab9-47d4-9a96-4629eb32ad88] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:24.986487 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9e577500-f63d-4b11-bc34-686753681948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:24.986982 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9e577500-f63d-4b11-bc34-686753681948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:24.987672 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9e577500-f63d-4b11-bc34-686753681948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:24.988147 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9e577500-f63d-4b11-bc34-686753681948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:24.988602 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9e577500-f63d-4b11-bc34-686753681948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:24.989024 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9e577500-f63d-4b11-bc34-686753681948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:25.244873 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-9e577500-f63d-4b11-bc34-686753681948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:25.253586 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-9e577500-f63d-4b11-bc34-686753681948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88" status: 200 len: 1210 microversion: 2.1 time: 0.279737 Oct 24 13:25:25.254177 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 514/1053] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:24 2022] GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88 => generated 1210 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:26.279509 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-366f52a6-4272-4528-831d-51e8b5719b6e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:26.280130 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-366f52a6-4272-4528-831d-51e8b5719b6e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 5ea7170c-6ab9-47d4-9a96-4629eb32ad88] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:26.286996 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-366f52a6-4272-4528-831d-51e8b5719b6e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:26.287456 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-366f52a6-4272-4528-831d-51e8b5719b6e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:26.287891 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-366f52a6-4272-4528-831d-51e8b5719b6e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:26.288585 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-366f52a6-4272-4528-831d-51e8b5719b6e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:26.289041 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-366f52a6-4272-4528-831d-51e8b5719b6e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:26.289462 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-366f52a6-4272-4528-831d-51e8b5719b6e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:26.424402 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-366f52a6-4272-4528-831d-51e8b5719b6e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:26.432371 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-366f52a6-4272-4528-831d-51e8b5719b6e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88" status: 200 len: 1265 microversion: 2.1 time: 0.156943 Oct 24 13:25:26.432953 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 540/1054] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:26 2022] GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:26.624129 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [req-2532bc86-18d8-4762-9988-ad097ca0850b req-2d19dd3c-9b34-4950-a382-025bcb384091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ea7170c-6ab9-47d4-9a96-4629eb32ad88", "tag": "332aa905-b1c8-4ddd-8186-37badc764684"}]} {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:25:26.633679 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-2532bc86-18d8-4762-9988-ad097ca0850b req-2d19dd3c-9b34-4950-a382-025bcb384091 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:26.634173 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-2532bc86-18d8-4762-9988-ad097ca0850b req-2d19dd3c-9b34-4950-a382-025bcb384091 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:26.634863 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [req-2532bc86-18d8-4762-9988-ad097ca0850b req-2d19dd3c-9b34-4950-a382-025bcb384091 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:26.647330 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.compute.server_external_events [req-2532bc86-18d8-4762-9988-ad097ca0850b req-2d19dd3c-9b34-4950-a382-025bcb384091 service nova] Creating event network-changed:332aa905-b1c8-4ddd-8186-37badc764684 for instance 5ea7170c-6ab9-47d4-9a96-4629eb32ad88 on hv-cinder-86248 Oct 24 13:25:26.652399 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [req-2532bc86-18d8-4762-9988-ad097ca0850b req-2d19dd3c-9b34-4950-a382-025bcb384091 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032912 Oct 24 13:25:26.653815 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 515/1055] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:25:27.455761 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-82075c12-3d2f-4722-bc8b-4cccc1c62840 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:27.456389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-82075c12-3d2f-4722-bc8b-4cccc1c62840 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 5ea7170c-6ab9-47d4-9a96-4629eb32ad88] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:27.462916 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-82075c12-3d2f-4722-bc8b-4cccc1c62840 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:27.463438 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-82075c12-3d2f-4722-bc8b-4cccc1c62840 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:27.463875 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-82075c12-3d2f-4722-bc8b-4cccc1c62840 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:27.464573 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-82075c12-3d2f-4722-bc8b-4cccc1c62840 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:27.465029 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-82075c12-3d2f-4722-bc8b-4cccc1c62840 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:27.465458 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-82075c12-3d2f-4722-bc8b-4cccc1c62840 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:27.605001 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-82075c12-3d2f-4722-bc8b-4cccc1c62840 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:27.613207 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-82075c12-3d2f-4722-bc8b-4cccc1c62840 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88" status: 200 len: 1265 microversion: 2.1 time: 0.161359 Oct 24 13:25:27.613775 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 541/1056] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:27 2022] GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:28.638719 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-a29d0c49-61e3-4d9f-9126-45da2b89b4a6 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:28.639450 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-a29d0c49-61e3-4d9f-9126-45da2b89b4a6 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 5ea7170c-6ab9-47d4-9a96-4629eb32ad88] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:28.645515 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a29d0c49-61e3-4d9f-9126-45da2b89b4a6 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:28.645996 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a29d0c49-61e3-4d9f-9126-45da2b89b4a6 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:28.646441 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a29d0c49-61e3-4d9f-9126-45da2b89b4a6 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:28.647141 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a29d0c49-61e3-4d9f-9126-45da2b89b4a6 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:28.647599 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a29d0c49-61e3-4d9f-9126-45da2b89b4a6 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:28.648022 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-a29d0c49-61e3-4d9f-9126-45da2b89b4a6 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:28.778105 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-a29d0c49-61e3-4d9f-9126-45da2b89b4a6 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:28.785714 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-a29d0c49-61e3-4d9f-9126-45da2b89b4a6 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88" status: 200 len: 1265 microversion: 2.1 time: 0.152607 Oct 24 13:25:28.786285 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 516/1057] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:28 2022] GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:29.808967 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-1e7d1f61-33d1-4176-b5d6-a92bba930256 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:29.809778 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-1e7d1f61-33d1-4176-b5d6-a92bba930256 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 5ea7170c-6ab9-47d4-9a96-4629eb32ad88] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:29.816195 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1e7d1f61-33d1-4176-b5d6-a92bba930256 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:29.816671 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1e7d1f61-33d1-4176-b5d6-a92bba930256 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:29.817106 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1e7d1f61-33d1-4176-b5d6-a92bba930256 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:29.817785 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1e7d1f61-33d1-4176-b5d6-a92bba930256 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:29.818237 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1e7d1f61-33d1-4176-b5d6-a92bba930256 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:29.818681 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-1e7d1f61-33d1-4176-b5d6-a92bba930256 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:29.948142 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-1e7d1f61-33d1-4176-b5d6-a92bba930256 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:29.957880 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-1e7d1f61-33d1-4176-b5d6-a92bba930256 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88" status: 200 len: 1265 microversion: 2.1 time: 0.152885 Oct 24 13:25:29.958506 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 542/1058] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:29 2022] GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:30.979922 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-ed334e9a-d887-44cc-a623-3956cc7efb04 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:30.980535 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-ed334e9a-d887-44cc-a623-3956cc7efb04 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 5ea7170c-6ab9-47d4-9a96-4629eb32ad88] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:30.986958 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ed334e9a-d887-44cc-a623-3956cc7efb04 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:30.987471 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ed334e9a-d887-44cc-a623-3956cc7efb04 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:30.987904 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ed334e9a-d887-44cc-a623-3956cc7efb04 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:30.988588 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ed334e9a-d887-44cc-a623-3956cc7efb04 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:30.989044 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ed334e9a-d887-44cc-a623-3956cc7efb04 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:30.989467 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-ed334e9a-d887-44cc-a623-3956cc7efb04 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:31.121214 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-ed334e9a-d887-44cc-a623-3956cc7efb04 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:31.129561 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-ed334e9a-d887-44cc-a623-3956cc7efb04 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88" status: 200 len: 1265 microversion: 2.1 time: 0.153537 Oct 24 13:25:31.130123 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 517/1059] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:30 2022] GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:32.159724 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-fc960926-01c6-4c0d-9f21-80cc3468c1fb tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:32.160335 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-fc960926-01c6-4c0d-9f21-80cc3468c1fb tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 5ea7170c-6ab9-47d4-9a96-4629eb32ad88] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:32.166750 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fc960926-01c6-4c0d-9f21-80cc3468c1fb tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:32.167269 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fc960926-01c6-4c0d-9f21-80cc3468c1fb tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:32.167708 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fc960926-01c6-4c0d-9f21-80cc3468c1fb tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:32.168402 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fc960926-01c6-4c0d-9f21-80cc3468c1fb tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:32.169057 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fc960926-01c6-4c0d-9f21-80cc3468c1fb tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:32.169480 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-fc960926-01c6-4c0d-9f21-80cc3468c1fb tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:32.301119 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-fc960926-01c6-4c0d-9f21-80cc3468c1fb tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:32.308652 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-fc960926-01c6-4c0d-9f21-80cc3468c1fb tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88" status: 200 len: 1265 microversion: 2.1 time: 0.152846 Oct 24 13:25:32.309738 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 543/1060] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:32 2022] GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:33.331750 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-97ed3eab-338f-4a79-bbbe-470819b5931a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:33.332302 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-97ed3eab-338f-4a79-bbbe-470819b5931a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 5ea7170c-6ab9-47d4-9a96-4629eb32ad88] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:33.338715 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-97ed3eab-338f-4a79-bbbe-470819b5931a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:33.339244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-97ed3eab-338f-4a79-bbbe-470819b5931a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:33.339684 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-97ed3eab-338f-4a79-bbbe-470819b5931a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:33.341228 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-97ed3eab-338f-4a79-bbbe-470819b5931a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:33.341705 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-97ed3eab-338f-4a79-bbbe-470819b5931a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:33.342133 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-97ed3eab-338f-4a79-bbbe-470819b5931a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:33.474266 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-97ed3eab-338f-4a79-bbbe-470819b5931a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:33.482171 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-97ed3eab-338f-4a79-bbbe-470819b5931a tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88" status: 200 len: 1265 microversion: 2.1 time: 0.154422 Oct 24 13:25:33.482738 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 518/1061] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:33 2022] GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:34.505395 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-add70e91-fac4-4e72-aa98-d3fdd1e7d07b tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:34.506018 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-add70e91-fac4-4e72-aa98-d3fdd1e7d07b tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 5ea7170c-6ab9-47d4-9a96-4629eb32ad88] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:34.508501 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell0:SELECT=2 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:34.514194 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-add70e91-fac4-4e72-aa98-d3fdd1e7d07b tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:34.514685 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-add70e91-fac4-4e72-aa98-d3fdd1e7d07b tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:34.515378 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-add70e91-fac4-4e72-aa98-d3fdd1e7d07b tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:34.515879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-add70e91-fac4-4e72-aa98-d3fdd1e7d07b tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:34.516333 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-add70e91-fac4-4e72-aa98-d3fdd1e7d07b tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:34.516764 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-add70e91-fac4-4e72-aa98-d3fdd1e7d07b tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:34.651676 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-add70e91-fac4-4e72-aa98-d3fdd1e7d07b tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:34.660295 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-add70e91-fac4-4e72-aa98-d3fdd1e7d07b tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88" status: 200 len: 1265 microversion: 2.1 time: 0.158898 Oct 24 13:25:34.660853 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 544/1062] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:34 2022] GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:35.685186 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-afefeb63-4dd4-44ce-b954-4747d8efb3e8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:35.685813 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-afefeb63-4dd4-44ce-b954-4747d8efb3e8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 5ea7170c-6ab9-47d4-9a96-4629eb32ad88] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:35.687883 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=2 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:35.688535 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell0:SELECT=6 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:25:35.694790 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-afefeb63-4dd4-44ce-b954-4747d8efb3e8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:35.695308 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-afefeb63-4dd4-44ce-b954-4747d8efb3e8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:35.695741 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-afefeb63-4dd4-44ce-b954-4747d8efb3e8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:35.696455 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-afefeb63-4dd4-44ce-b954-4747d8efb3e8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:35.696901 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-afefeb63-4dd4-44ce-b954-4747d8efb3e8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:35.697320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-afefeb63-4dd4-44ce-b954-4747d8efb3e8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:35.828843 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-afefeb63-4dd4-44ce-b954-4747d8efb3e8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:35.836534 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-afefeb63-4dd4-44ce-b954-4747d8efb3e8 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88" status: 200 len: 1265 microversion: 2.1 time: 0.156280 Oct 24 13:25:35.837077 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 519/1063] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:35 2022] GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:36.554676 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-03eafafd-91d8-4334-a7f8-9aa4fd46b859 req-058339cd-25a0-46ce-bfdb-52be925891f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea7170c-6ab9-47d4-9a96-4629eb32ad88", "name": "network-vif-plugged", "status": "completed", "tag": "332aa905-b1c8-4ddd-8186-37badc764684"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:25:36.564841 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-03eafafd-91d8-4334-a7f8-9aa4fd46b859 req-058339cd-25a0-46ce-bfdb-52be925891f3 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:36.565414 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-03eafafd-91d8-4334-a7f8-9aa4fd46b859 req-058339cd-25a0-46ce-bfdb-52be925891f3 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:36.565943 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-03eafafd-91d8-4334-a7f8-9aa4fd46b859 req-058339cd-25a0-46ce-bfdb-52be925891f3 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:36.577976 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-03eafafd-91d8-4334-a7f8-9aa4fd46b859 req-058339cd-25a0-46ce-bfdb-52be925891f3 service nova] Creating event network-vif-plugged:332aa905-b1c8-4ddd-8186-37badc764684 for instance 5ea7170c-6ab9-47d4-9a96-4629eb32ad88 on hv-cinder-86248 Oct 24 13:25:36.582881 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-03eafafd-91d8-4334-a7f8-9aa4fd46b859 req-058339cd-25a0-46ce-bfdb-52be925891f3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032591 Oct 24 13:25:36.583502 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 545/1064] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:25:36.860075 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-6ccf3c31-14bc-47e5-aa2e-e60d35831acd tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:36.860676 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-6ccf3c31-14bc-47e5-aa2e-e60d35831acd tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 5ea7170c-6ab9-47d4-9a96-4629eb32ad88] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:36.868062 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6ccf3c31-14bc-47e5-aa2e-e60d35831acd tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:36.868612 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6ccf3c31-14bc-47e5-aa2e-e60d35831acd tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:36.869188 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6ccf3c31-14bc-47e5-aa2e-e60d35831acd tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:36.870412 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6ccf3c31-14bc-47e5-aa2e-e60d35831acd tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:36.871147 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6ccf3c31-14bc-47e5-aa2e-e60d35831acd tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:36.872174 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-6ccf3c31-14bc-47e5-aa2e-e60d35831acd tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:37.067936 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-6ccf3c31-14bc-47e5-aa2e-e60d35831acd tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:37.075802 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-6ccf3c31-14bc-47e5-aa2e-e60d35831acd tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88" status: 200 len: 1265 microversion: 2.1 time: 0.219807 Oct 24 13:25:37.076371 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 520/1065] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:36 2022] GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88 => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:38.099768 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-08847ed0-30d3-41c2-a9c7-a5b6f3119cb7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:38.100481 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-08847ed0-30d3-41c2-a9c7-a5b6f3119cb7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 5ea7170c-6ab9-47d4-9a96-4629eb32ad88] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:38.106615 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08847ed0-30d3-41c2-a9c7-a5b6f3119cb7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:38.107164 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08847ed0-30d3-41c2-a9c7-a5b6f3119cb7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:38.107603 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08847ed0-30d3-41c2-a9c7-a5b6f3119cb7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:38.108293 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08847ed0-30d3-41c2-a9c7-a5b6f3119cb7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:38.108753 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08847ed0-30d3-41c2-a9c7-a5b6f3119cb7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:38.109179 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-08847ed0-30d3-41c2-a9c7-a5b6f3119cb7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:38.243693 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-08847ed0-30d3-41c2-a9c7-a5b6f3119cb7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:38.252089 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-08847ed0-30d3-41c2-a9c7-a5b6f3119cb7 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88" status: 200 len: 1451 microversion: 2.1 time: 0.157039 Oct 24 13:25:38.252659 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 546/1066] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:38 2022] GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:38.274957 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-c485ab1e-96d5-4c86-bdda-380d807cbd5d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:25:38.275601 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-c485ab1e-96d5-4c86-bdda-380d807cbd5d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 5ea7170c-6ab9-47d4-9a96-4629eb32ad88] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:25:38.281624 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c485ab1e-96d5-4c86-bdda-380d807cbd5d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:38.282106 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c485ab1e-96d5-4c86-bdda-380d807cbd5d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:38.282538 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c485ab1e-96d5-4c86-bdda-380d807cbd5d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:38.283261 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c485ab1e-96d5-4c86-bdda-380d807cbd5d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:38.283712 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c485ab1e-96d5-4c86-bdda-380d807cbd5d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:38.284134 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-c485ab1e-96d5-4c86-bdda-380d807cbd5d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:38.461654 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-c485ab1e-96d5-4c86-bdda-380d807cbd5d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:25:38.470040 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-c485ab1e-96d5-4c86-bdda-380d807cbd5d tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88" status: 200 len: 1451 microversion: 2.1 time: 0.198952 Oct 24 13:25:38.470600 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 521/1067] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:25:38 2022] GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88 => generated 1451 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:25:40.080730 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-d8623c1c-860c-4c9e-b00e-b91fbb7a6b7a req-6b203d6e-9bea-4201-acb3-8c6bd9cd7cdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ea7170c-6ab9-47d4-9a96-4629eb32ad88", "tag": "332aa905-b1c8-4ddd-8186-37badc764684"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:25:40.090026 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-d8623c1c-860c-4c9e-b00e-b91fbb7a6b7a req-6b203d6e-9bea-4201-acb3-8c6bd9cd7cdf service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:25:40.090503 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-d8623c1c-860c-4c9e-b00e-b91fbb7a6b7a req-6b203d6e-9bea-4201-acb3-8c6bd9cd7cdf service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:25:40.090924 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-d8623c1c-860c-4c9e-b00e-b91fbb7a6b7a req-6b203d6e-9bea-4201-acb3-8c6bd9cd7cdf service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:25:40.102146 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-d8623c1c-860c-4c9e-b00e-b91fbb7a6b7a req-6b203d6e-9bea-4201-acb3-8c6bd9cd7cdf service nova] Creating event network-changed:332aa905-b1c8-4ddd-8186-37badc764684 for instance 5ea7170c-6ab9-47d4-9a96-4629eb32ad88 on hv-cinder-86248 Oct 24 13:25:40.107744 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-d8623c1c-860c-4c9e-b00e-b91fbb7a6b7a req-6b203d6e-9bea-4201-acb3-8c6bd9cd7cdf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030340 Oct 24 13:25:40.108330 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 547/1068] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:27:08.631647 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:27:08.632597 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG dbcounter [-] [118915] Writing DB stats nova_cell1:SELECT=46 {{(pid=118915) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:27:08.635026 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_api:SELECT=20 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:27:08.636388 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG dbcounter [-] [118914] Writing DB stats nova_cell1:SELECT=40 {{(pid=118914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 13:27:08.637975 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 24 13:27:08.638113 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Mon Oct 24 13:27:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Oct 24 13:27:08.638338 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-837b44ba-3491-4f47-8667-85bfba2613f1 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:08.639931 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-837b44ba-3491-4f47-8667-85bfba2613f1 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 5ea7170c-6ab9-47d4-9a96-4629eb32ad88] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:08.646423 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-54f63681-bb6b-4dfd-8d58-4961088a30e1 req-e2536e0b-3e2e-457a-a588-b065ff683f9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ea7170c-6ab9-47d4-9a96-4629eb32ad88", "tag": "332aa905-b1c8-4ddd-8186-37badc764684"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:27:08.648779 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-837b44ba-3491-4f47-8667-85bfba2613f1 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:08.649268 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-837b44ba-3491-4f47-8667-85bfba2613f1 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:08.649704 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-837b44ba-3491-4f47-8667-85bfba2613f1 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:08.650402 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-837b44ba-3491-4f47-8667-85bfba2613f1 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:08.650891 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-837b44ba-3491-4f47-8667-85bfba2613f1 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:08.651340 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-837b44ba-3491-4f47-8667-85bfba2613f1 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:08.660004 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-54f63681-bb6b-4dfd-8d58-4961088a30e1 req-e2536e0b-3e2e-457a-a588-b065ff683f9b service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:08.660493 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-54f63681-bb6b-4dfd-8d58-4961088a30e1 req-e2536e0b-3e2e-457a-a588-b065ff683f9b service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:08.660917 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-54f63681-bb6b-4dfd-8d58-4961088a30e1 req-e2536e0b-3e2e-457a-a588-b065ff683f9b service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:08.675603 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-54f63681-bb6b-4dfd-8d58-4961088a30e1 req-e2536e0b-3e2e-457a-a588-b065ff683f9b service nova] Creating event network-changed:332aa905-b1c8-4ddd-8186-37badc764684 for instance 5ea7170c-6ab9-47d4-9a96-4629eb32ad88 on hv-cinder-86248 Oct 24 13:27:08.680671 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-837b44ba-3491-4f47-8667-85bfba2613f1 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 5ea7170c-6ab9-47d4-9a96-4629eb32ad88] Going to try to terminate instance {{(pid=118915) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:27:08.682634 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-54f63681-bb6b-4dfd-8d58-4961088a30e1 req-e2536e0b-3e2e-457a-a588-b065ff683f9b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050686 Oct 24 13:27:08.683292 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 548/1069] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:27:08.772586 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-837b44ba-3491-4f47-8667-85bfba2613f1 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88" status: 204 len: 0 microversion: 2.1 time: 0.142787 Oct 24 13:27:08.775137 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 522/1070] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:27:08 2022] DELETE /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:27:08.783596 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-ba1eb310-62f7-433a-bfda-e6abdb4b7f33 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:08.784326 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-ba1eb310-62f7-433a-bfda-e6abdb4b7f33 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 5ea7170c-6ab9-47d4-9a96-4629eb32ad88] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:08.790524 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ba1eb310-62f7-433a-bfda-e6abdb4b7f33 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:08.791103 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ba1eb310-62f7-433a-bfda-e6abdb4b7f33 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:08.791512 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ba1eb310-62f7-433a-bfda-e6abdb4b7f33 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:08.792193 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ba1eb310-62f7-433a-bfda-e6abdb4b7f33 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:08.792644 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ba1eb310-62f7-433a-bfda-e6abdb4b7f33 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:08.793063 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-ba1eb310-62f7-433a-bfda-e6abdb4b7f33 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:08.929422 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-ba1eb310-62f7-433a-bfda-e6abdb4b7f33 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:08.938048 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-ba1eb310-62f7-433a-bfda-e6abdb4b7f33 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88" status: 200 len: 1576 microversion: 2.1 time: 0.159943 Oct 24 13:27:08.938616 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 549/1071] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:08 2022] GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 24 13:27:09.962774 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-9b100b84-7ce0-4477-8a93-9f02c9a16e99 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:09.963542 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-9b100b84-7ce0-4477-8a93-9f02c9a16e99 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 5ea7170c-6ab9-47d4-9a96-4629eb32ad88] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:09.970235 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9b100b84-7ce0-4477-8a93-9f02c9a16e99 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:09.970551 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9b100b84-7ce0-4477-8a93-9f02c9a16e99 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:09.970992 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9b100b84-7ce0-4477-8a93-9f02c9a16e99 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:09.971718 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9b100b84-7ce0-4477-8a93-9f02c9a16e99 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:09.972177 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9b100b84-7ce0-4477-8a93-9f02c9a16e99 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:09.972632 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-9b100b84-7ce0-4477-8a93-9f02c9a16e99 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:10.150818 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-9b100b84-7ce0-4477-8a93-9f02c9a16e99 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:10.158527 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-9b100b84-7ce0-4477-8a93-9f02c9a16e99 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88" status: 200 len: 1576 microversion: 2.1 time: 0.200376 Oct 24 13:27:10.159292 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 523/1072] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:09 2022] GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88 => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:10.763339 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-3183a60b-f358-4597-83ab-aa0c7633d6c5 req-2805fda5-15cf-425f-a477-cea0ac1fd603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea7170c-6ab9-47d4-9a96-4629eb32ad88", "name": "network-vif-deleted", "tag": "332aa905-b1c8-4ddd-8186-37badc764684"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:27:10.773848 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-3183a60b-f358-4597-83ab-aa0c7633d6c5 req-2805fda5-15cf-425f-a477-cea0ac1fd603 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:10.774320 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-3183a60b-f358-4597-83ab-aa0c7633d6c5 req-2805fda5-15cf-425f-a477-cea0ac1fd603 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:10.774748 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-3183a60b-f358-4597-83ab-aa0c7633d6c5 req-2805fda5-15cf-425f-a477-cea0ac1fd603 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:10.786180 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-3183a60b-f358-4597-83ab-aa0c7633d6c5 req-2805fda5-15cf-425f-a477-cea0ac1fd603 service nova] Creating event network-vif-deleted:332aa905-b1c8-4ddd-8186-37badc764684 for instance 5ea7170c-6ab9-47d4-9a96-4629eb32ad88 on hv-cinder-86248 Oct 24 13:27:10.790935 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-3183a60b-f358-4597-83ab-aa0c7633d6c5 req-2805fda5-15cf-425f-a477-cea0ac1fd603 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031384 Oct 24 13:27:10.791552 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 550/1073] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:27:11.182243 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-abd297f3-c0ea-4b50-8abc-1b50bff78948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:11.182889 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-abd297f3-c0ea-4b50-8abc-1b50bff78948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 5ea7170c-6ab9-47d4-9a96-4629eb32ad88] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:11.190097 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-abd297f3-c0ea-4b50-8abc-1b50bff78948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:11.190575 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-abd297f3-c0ea-4b50-8abc-1b50bff78948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:11.191011 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-abd297f3-c0ea-4b50-8abc-1b50bff78948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:11.191741 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-abd297f3-c0ea-4b50-8abc-1b50bff78948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:11.192197 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-abd297f3-c0ea-4b50-8abc-1b50bff78948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:11.192618 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-abd297f3-c0ea-4b50-8abc-1b50bff78948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:11.223274 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-abd297f3-c0ea-4b50-8abc-1b50bff78948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:11.223752 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-abd297f3-c0ea-4b50-8abc-1b50bff78948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:11.224190 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-abd297f3-c0ea-4b50-8abc-1b50bff78948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:11.224635 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.objects.instance [None req-abd297f3-c0ea-4b50-8abc-1b50bff78948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lazy-loading 'fault' on Instance uuid 5ea7170c-6ab9-47d4-9a96-4629eb32ad88 {{(pid=118915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:27:11.267688 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-abd297f3-c0ea-4b50-8abc-1b50bff78948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:11.275380 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-abd297f3-c0ea-4b50-8abc-1b50bff78948 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88" status: 200 len: 1230 microversion: 2.1 time: 0.096885 Oct 24 13:27:11.275902 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 524/1074] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:11 2022] GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88 => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:12.299019 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-3517869a-1395-498f-92fb-f6044f2d1fb9 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:12.299673 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-3517869a-1395-498f-92fb-f6044f2d1fb9 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 5ea7170c-6ab9-47d4-9a96-4629eb32ad88] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:12.305743 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3517869a-1395-498f-92fb-f6044f2d1fb9 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:12.306232 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3517869a-1395-498f-92fb-f6044f2d1fb9 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:12.306668 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3517869a-1395-498f-92fb-f6044f2d1fb9 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:12.307392 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3517869a-1395-498f-92fb-f6044f2d1fb9 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:12.307844 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3517869a-1395-498f-92fb-f6044f2d1fb9 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:12.308265 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-3517869a-1395-498f-92fb-f6044f2d1fb9 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:12.321299 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-3517869a-1395-498f-92fb-f6044f2d1fb9 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] HTTP exception thrown: Instance 5ea7170c-6ab9-47d4-9a96-4629eb32ad88 could not be found. Oct 24 13:27:12.322879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-3517869a-1395-498f-92fb-f6044f2d1fb9 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Request method failure captured: Oct 24 13:27:12.322879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88 HTTP/1.1 Oct 24 13:27:12.322879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:27:12.322879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:27:12.322879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:27:12.322879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:27:12.322879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:27:12.322879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:27:12.322879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:27:12.322879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:27:12.322879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVpEilMaq7mAXZHY4orOYYZmWyICm8ZHjnejcM_953w-RaE7YGocX30NOBhp8jtyJCAyHvKmNnpfTnH1FQ1PV3Ro--_ykDkPAtHFZT6g_IIH_Yt6r2AFI6TxvFSQPYV10WjGOb2Ffc6sSbVPjxu1Awzv4TfPYTIEghsJnziZjbVEWMCw Oct 24 13:27:12.322879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:27:12.322879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:27:12.322879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:27:12.322879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:27:12.322879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:27:12.322879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:27:12.322879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: e5f4729aa5f44fe08096bed3438e8f7e Oct 24 13:27:12.322879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-TestVolumeBootPattern-1997881197 Oct 24 13:27:12.322879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:27:12.322879 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:27:12.324839 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e5f4729aa5f44fe08096bed3438e8f7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5f4729aa5f44fe08096bed3438e8f7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5f4729aa5f44fe08096bed3438e8f7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e5f4729aa5f44fe08096bed3438e8f7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:27:12.324839 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-TestVolumeBootPattern-1997881197 Oct 24 13:27:12.324839 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: e5f4729aa5f44fe08096bed3438e8f7e Oct 24 13:27:12.324839 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-TestVolumeBootPattern-1997881197 Oct 24 13:27:12.324839 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-TestVolumeBootPattern-1997881197-project Oct 24 13:27:12.324839 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:27:12.324839 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:27:12.324839 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: 1fe85edb1188403d84072d19128e07d5 Oct 24 13:27:12.324839 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-TestVolumeBootPattern-1997881197-project Oct 24 13:27:12.324839 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:27:12.324839 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Instance 5ea7170c-6ab9-47d4-9a96-4629eb32ad88 could not be found. Oct 24 13:27:12.324839 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': '5ea7170c-6ab9-47d4-9a96-4629eb32ad88'} Oct 24 13:27:12.325878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:27:12.325878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:12.325878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:27:12.325878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:27:12.325878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:27:12.325878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:27:12.325878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:27:12.325878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:27:12.325878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:27:12.325878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:27:12.325878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ea7170c-6ab9-47d4-9a96-4629eb32ad88 could not be found. Oct 24 13:27:12.325878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:27:12.325878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:27:12.325878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:27:12.325878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:12.325878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:27:12.325878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:27:12.325878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:27:12.325878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:27:12.325878 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:27:12.328572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:27:12.328572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:27:12.328572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:27:12.328572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:27:12.328572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:27:12.328572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:27:12.328572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:27:12.328572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ea7170c-6ab9-47d4-9a96-4629eb32ad88 could not be found. Oct 24 13:27:12.328572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:27:12.328572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:27:12.328572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:27:12.328572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:12.328572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:27:12.328572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:27:12.328572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:27:12.328572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:27:12.328572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ea7170c-6ab9-47d4-9a96-4629eb32ad88 could not be found. Oct 24 13:27:12.328572 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:27:12.330182 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-3517869a-1395-498f-92fb-f6044f2d1fb9 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Returning 404 to user: Instance 5ea7170c-6ab9-47d4-9a96-4629eb32ad88 could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:27:12.330182 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-3517869a-1395-498f-92fb-f6044f2d1fb9 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88" status: 404 len: 111 microversion: 2.1 time: 0.030094 Oct 24 13:27:12.330182 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 551/1075] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:12 2022] GET /compute/v2.1/servers/5ea7170c-6ab9-47d4-9a96-4629eb32ad88 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:27:15.381801 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-2981cfe3-2658-426c-973a-61114af51b1e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:15.382320 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-2981cfe3-2658-426c-973a-61114af51b1e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 220e25f4-701f-4b80-8dbb-59ccce3aa048] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:15.384488 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-a8828b18-0ce7-4980-af7c-d07b3a206016 req-ebd04c65-d80d-4c0e-87c9-412edd4e1a9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "220e25f4-701f-4b80-8dbb-59ccce3aa048", "tag": "749b73b0-1746-43c7-ab4e-7e32756bfd58"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:27:15.389937 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2981cfe3-2658-426c-973a-61114af51b1e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:15.390500 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2981cfe3-2658-426c-973a-61114af51b1e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:15.391001 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2981cfe3-2658-426c-973a-61114af51b1e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:15.391972 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2981cfe3-2658-426c-973a-61114af51b1e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:15.392460 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2981cfe3-2658-426c-973a-61114af51b1e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:15.392879 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-2981cfe3-2658-426c-973a-61114af51b1e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:15.394985 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-a8828b18-0ce7-4980-af7c-d07b3a206016 req-ebd04c65-d80d-4c0e-87c9-412edd4e1a9b service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:15.395557 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-a8828b18-0ce7-4980-af7c-d07b3a206016 req-ebd04c65-d80d-4c0e-87c9-412edd4e1a9b service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:15.396052 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-a8828b18-0ce7-4980-af7c-d07b3a206016 req-ebd04c65-d80d-4c0e-87c9-412edd4e1a9b service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:15.408239 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-a8828b18-0ce7-4980-af7c-d07b3a206016 req-ebd04c65-d80d-4c0e-87c9-412edd4e1a9b service nova] Creating event network-changed:749b73b0-1746-43c7-ab4e-7e32756bfd58 for instance 220e25f4-701f-4b80-8dbb-59ccce3aa048 on hv-cinder-86248 Oct 24 13:27:15.413806 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-a8828b18-0ce7-4980-af7c-d07b3a206016 req-ebd04c65-d80d-4c0e-87c9-412edd4e1a9b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033265 Oct 24 13:27:15.414723 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 552/1076] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 24 13:27:15.419849 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-2981cfe3-2658-426c-973a-61114af51b1e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 220e25f4-701f-4b80-8dbb-59ccce3aa048] Going to try to terminate instance {{(pid=118915) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 24 13:27:15.522898 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-2981cfe3-2658-426c-973a-61114af51b1e tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "DELETE /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048" status: 204 len: 0 microversion: 2.1 time: 0.144959 Oct 24 13:27:15.523805 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 525/1077] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:27:15 2022] DELETE /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 24 13:27:15.533951 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-9e6bfd7b-1fae-40de-a5f7-4dc5e12f3f89 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:15.535127 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-9e6bfd7b-1fae-40de-a5f7-4dc5e12f3f89 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 220e25f4-701f-4b80-8dbb-59ccce3aa048] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:15.542782 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9e6bfd7b-1fae-40de-a5f7-4dc5e12f3f89 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:15.543358 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9e6bfd7b-1fae-40de-a5f7-4dc5e12f3f89 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:15.543949 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9e6bfd7b-1fae-40de-a5f7-4dc5e12f3f89 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:15.544656 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9e6bfd7b-1fae-40de-a5f7-4dc5e12f3f89 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:15.545100 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9e6bfd7b-1fae-40de-a5f7-4dc5e12f3f89 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:15.546206 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-9e6bfd7b-1fae-40de-a5f7-4dc5e12f3f89 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:15.697058 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.policy [None req-9e6bfd7b-1fae-40de-a5f7-4dc5e12f3f89 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118914) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:15.706253 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-9e6bfd7b-1fae-40de-a5f7-4dc5e12f3f89 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048" status: 200 len: 1576 microversion: 2.1 time: 0.177696 Oct 24 13:27:15.706948 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 553/1078] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:15 2022] GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048 => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:16.730786 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-cd4b0e5e-6769-40fb-b2d3-66fc466a29e9 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:16.731521 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-cd4b0e5e-6769-40fb-b2d3-66fc466a29e9 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 220e25f4-701f-4b80-8dbb-59ccce3aa048] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:16.738308 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-cd4b0e5e-6769-40fb-b2d3-66fc466a29e9 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:16.738787 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-cd4b0e5e-6769-40fb-b2d3-66fc466a29e9 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:16.739258 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-cd4b0e5e-6769-40fb-b2d3-66fc466a29e9 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:16.739954 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-cd4b0e5e-6769-40fb-b2d3-66fc466a29e9 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:16.740409 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-cd4b0e5e-6769-40fb-b2d3-66fc466a29e9 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:16.740833 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-cd4b0e5e-6769-40fb-b2d3-66fc466a29e9 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:16.947385 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-cd4b0e5e-6769-40fb-b2d3-66fc466a29e9 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:16.956892 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-cd4b0e5e-6769-40fb-b2d3-66fc466a29e9 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048" status: 200 len: 1576 microversion: 2.1 time: 0.228620 Oct 24 13:27:16.970687 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 526/1079] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:16 2022] GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048 => generated 1576 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:17.667513 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [req-ec650ee7-4477-42b7-a5b9-d78398560ffd req-42d5184f-c821-46e6-9666-7b4a9b04a612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "220e25f4-701f-4b80-8dbb-59ccce3aa048", "name": "network-vif-deleted", "tag": "749b73b0-1746-43c7-ab4e-7e32756bfd58"}]} {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 24 13:27:17.678851 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-ec650ee7-4477-42b7-a5b9-d78398560ffd req-42d5184f-c821-46e6-9666-7b4a9b04a612 service nova] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:17.679364 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-ec650ee7-4477-42b7-a5b9-d78398560ffd req-42d5184f-c821-46e6-9666-7b4a9b04a612 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:17.679794 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [req-ec650ee7-4477-42b7-a5b9-d78398560ffd req-42d5184f-c821-46e6-9666-7b4a9b04a612 service nova] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:17.692994 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.compute.server_external_events [req-ec650ee7-4477-42b7-a5b9-d78398560ffd req-42d5184f-c821-46e6-9666-7b4a9b04a612 service nova] Creating event network-vif-deleted:749b73b0-1746-43c7-ab4e-7e32756bfd58 for instance 220e25f4-701f-4b80-8dbb-59ccce3aa048 on hv-cinder-86248 Oct 24 13:27:17.699326 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [req-ec650ee7-4477-42b7-a5b9-d78398560ffd req-42d5184f-c821-46e6-9666-7b4a9b04a612 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034923 Oct 24 13:27:17.699916 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 554/1080] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Oct 24 13:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 24 13:27:17.977837 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-dafc9a88-1f13-4f88-bc6f-02517ba3bd82 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:17.979183 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-dafc9a88-1f13-4f88-bc6f-02517ba3bd82 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 220e25f4-701f-4b80-8dbb-59ccce3aa048] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:17.986672 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dafc9a88-1f13-4f88-bc6f-02517ba3bd82 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:17.987203 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dafc9a88-1f13-4f88-bc6f-02517ba3bd82 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:17.987642 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dafc9a88-1f13-4f88-bc6f-02517ba3bd82 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:17.988596 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dafc9a88-1f13-4f88-bc6f-02517ba3bd82 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:17.989190 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dafc9a88-1f13-4f88-bc6f-02517ba3bd82 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:17.989495 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dafc9a88-1f13-4f88-bc6f-02517ba3bd82 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:18.023282 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dafc9a88-1f13-4f88-bc6f-02517ba3bd82 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:18.023770 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dafc9a88-1f13-4f88-bc6f-02517ba3bd82 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:18.024402 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-dafc9a88-1f13-4f88-bc6f-02517ba3bd82 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:18.025063 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.objects.instance [None req-dafc9a88-1f13-4f88-bc6f-02517ba3bd82 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lazy-loading 'fault' on Instance uuid 220e25f4-701f-4b80-8dbb-59ccce3aa048 {{(pid=118915) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 24 13:27:18.068556 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.policy [None req-dafc9a88-1f13-4f88-bc6f-02517ba3bd82 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fe85edb1188403d84072d19128e07d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5f4729aa5f44fe08096bed3438e8f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118915) authorize /opt/stack/nova/nova/policy.py:199}} Oct 24 13:27:18.076926 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-dafc9a88-1f13-4f88-bc6f-02517ba3bd82 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048" status: 200 len: 1230 microversion: 2.1 time: 0.102801 Oct 24 13:27:18.077515 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 527/1081] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:17 2022] GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048 => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 24 13:27:19.101656 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-e8a8fcb4-3837-4f84-9907-5b33de01b212 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:19.102363 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-e8a8fcb4-3837-4f84-9907-5b33de01b212 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 220e25f4-701f-4b80-8dbb-59ccce3aa048] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:19.109379 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e8a8fcb4-3837-4f84-9907-5b33de01b212 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:19.110011 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e8a8fcb4-3837-4f84-9907-5b33de01b212 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:19.110448 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e8a8fcb4-3837-4f84-9907-5b33de01b212 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:19.111185 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e8a8fcb4-3837-4f84-9907-5b33de01b212 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:19.111627 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e8a8fcb4-3837-4f84-9907-5b33de01b212 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:19.112150 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-e8a8fcb4-3837-4f84-9907-5b33de01b212 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:19.125655 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-e8a8fcb4-3837-4f84-9907-5b33de01b212 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] HTTP exception thrown: Instance 220e25f4-701f-4b80-8dbb-59ccce3aa048 could not be found. Oct 24 13:27:19.127272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-e8a8fcb4-3837-4f84-9907-5b33de01b212 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Request method failure captured: Oct 24 13:27:19.127272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048 HTTP/1.1 Oct 24 13:27:19.127272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:27:19.127272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:27:19.127272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:27:19.127272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:27:19.127272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:27:19.127272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:27:19.127272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:27:19.127272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:27:19.127272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVpEilMaq7mAXZHY4orOYYZmWyICm8ZHjnejcM_953w-RaE7YGocX30NOBhp8jtyJCAyHvKmNnpfTnH1FQ1PV3Ro--_ykDkPAtHFZT6g_IIH_Yt6r2AFI6TxvFSQPYV10WjGOb2Ffc6sSbVPjxu1Awzv4TfPYTIEghsJnziZjbVEWMCw Oct 24 13:27:19.127272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:27:19.127272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:27:19.127272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:27:19.127272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:27:19.127272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:27:19.127272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:27:19.127272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: e5f4729aa5f44fe08096bed3438e8f7e Oct 24 13:27:19.127272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-TestVolumeBootPattern-1997881197 Oct 24 13:27:19.127272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:27:19.127272 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:27:19.129056 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e5f4729aa5f44fe08096bed3438e8f7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5f4729aa5f44fe08096bed3438e8f7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5f4729aa5f44fe08096bed3438e8f7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e5f4729aa5f44fe08096bed3438e8f7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:27:19.129056 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-TestVolumeBootPattern-1997881197 Oct 24 13:27:19.129056 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: e5f4729aa5f44fe08096bed3438e8f7e Oct 24 13:27:19.129056 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-TestVolumeBootPattern-1997881197 Oct 24 13:27:19.129056 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-TestVolumeBootPattern-1997881197-project Oct 24 13:27:19.129056 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:27:19.129056 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:27:19.129056 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: 1fe85edb1188403d84072d19128e07d5 Oct 24 13:27:19.129056 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-TestVolumeBootPattern-1997881197-project Oct 24 13:27:19.129056 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:27:19.129056 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Instance 220e25f4-701f-4b80-8dbb-59ccce3aa048 could not be found. Oct 24 13:27:19.129056 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': '220e25f4-701f-4b80-8dbb-59ccce3aa048'} Oct 24 13:27:19.130226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:27:19.130226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:19.130226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:27:19.130226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:27:19.130226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:27:19.130226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:27:19.130226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:27:19.130226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:27:19.130226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:27:19.130226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:27:19.130226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 220e25f4-701f-4b80-8dbb-59ccce3aa048 could not be found. Oct 24 13:27:19.130226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:27:19.130226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:27:19.130226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:27:19.130226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:19.130226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:27:19.130226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:27:19.130226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:27:19.130226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:27:19.130226 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:27:19.131914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:27:19.131914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:27:19.131914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:27:19.131914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:27:19.131914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:27:19.131914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:27:19.131914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:27:19.131914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 220e25f4-701f-4b80-8dbb-59ccce3aa048 could not be found. Oct 24 13:27:19.131914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:27:19.131914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:27:19.131914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:27:19.131914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:19.131914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:27:19.131914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:27:19.131914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:27:19.131914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:27:19.131914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 220e25f4-701f-4b80-8dbb-59ccce3aa048 could not be found. Oct 24 13:27:19.131914 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:27:19.133785 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-e8a8fcb4-3837-4f84-9907-5b33de01b212 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Returning 404 to user: Instance 220e25f4-701f-4b80-8dbb-59ccce3aa048 could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:27:19.133785 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-e8a8fcb4-3837-4f84-9907-5b33de01b212 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048" status: 404 len: 111 microversion: 2.1 time: 0.031229 Oct 24 13:27:19.133785 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 555/1082] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:19 2022] GET /compute/v2.1/servers/220e25f4-701f-4b80-8dbb-59ccce3aa048 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:27:19.568099 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-e2129099-fc11-40ec-8dc0-81bff875bf35 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:19.568649 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.compute.api [None req-e2129099-fc11-40ec-8dc0-81bff875bf35 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Fetching instance by UUID {{(pid=118915) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:19.575286 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e2129099-fc11-40ec-8dc0-81bff875bf35 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:19.575770 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e2129099-fc11-40ec-8dc0-81bff875bf35 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:19.576214 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e2129099-fc11-40ec-8dc0-81bff875bf35 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:19.576991 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e2129099-fc11-40ec-8dc0-81bff875bf35 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:19.577448 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e2129099-fc11-40ec-8dc0-81bff875bf35 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:19.577872 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG oslo_concurrency.lockutils [None req-e2129099-fc11-40ec-8dc0-81bff875bf35 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118915) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:19.591146 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.wsgi [None req-e2129099-fc11-40ec-8dc0-81bff875bf35 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] HTTP exception thrown: Instance 540ac816-895b-4737-8d42-9b2c7817f334 could not be found. Oct 24 13:27:19.593572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-e2129099-fc11-40ec-8dc0-81bff875bf35 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Request method failure captured: Oct 24 13:27:19.593572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: request: DELETE /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 HTTP/1.1 Oct 24 13:27:19.593572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept: application/json Oct 24 13:27:19.593572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Accept-Encoding: identity Oct 24 13:27:19.593572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Connection: close Oct 24 13:27:19.593572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Length: 0 Oct 24 13:27:19.593572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Content-Type: application/json Oct 24 13:27:19.593572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Host: 10.222.0.42 Oct 24 13:27:19.593572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: Openstack-System-Scope: None Oct 24 13:27:19.593572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: User-Agent: python-urllib3/1.26.12 Oct 24 13:27:19.593572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Auth-Token: gAAAAABjVpEilMaq7mAXZHY4orOYYZmWyICm8ZHjnejcM_953w-RaE7YGocX30NOBhp8jtyJCAyHvKmNnpfTnH1FQ1PV3Ro--_ykDkPAtHFZT6g_IIH_Yt6r2AFI6TxvFSQPYV10WjGOb2Ffc6sSbVPjxu1Awzv4TfPYTIEghsJnziZjbVEWMCw Oct 24 13:27:19.593572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Id: None Oct 24 13:27:19.593572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Domain-Name: None Oct 24 13:27:19.593572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Identity-Status: Confirmed Oct 24 13:27:19.593572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Is-Admin-Project: True Oct 24 13:27:19.593572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Id: default Oct 24 13:27:19.593572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Domain-Name: Default Oct 24 13:27:19.593572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Id: e5f4729aa5f44fe08096bed3438e8f7e Oct 24 13:27:19.593572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Project-Name: tempest-TestVolumeBootPattern-1997881197 Oct 24 13:27:19.593572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Role: member,reader Oct 24 13:27:19.593572 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Roles: member,reader Oct 24 13:27:19.595364 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e5f4729aa5f44fe08096bed3438e8f7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5f4729aa5f44fe08096bed3438e8f7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5f4729aa5f44fe08096bed3438e8f7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e5f4729aa5f44fe08096bed3438e8f7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:27:19.595364 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant: tempest-TestVolumeBootPattern-1997881197 Oct 24 13:27:19.595364 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Id: e5f4729aa5f44fe08096bed3438e8f7e Oct 24 13:27:19.595364 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-Tenant-Name: tempest-TestVolumeBootPattern-1997881197 Oct 24 13:27:19.595364 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User: tempest-TestVolumeBootPattern-1997881197-project Oct 24 13:27:19.595364 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Id: default Oct 24 13:27:19.595364 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Domain-Name: Default Oct 24 13:27:19.595364 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Id: 1fe85edb1188403d84072d19128e07d5 Oct 24 13:27:19.595364 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: X-User-Name: tempest-TestVolumeBootPattern-1997881197-project Oct 24 13:27:19.595364 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: method: > Oct 24 13:27:19.595364 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: exception: Instance 540ac816-895b-4737-8d42-9b2c7817f334 could not be found. Oct 24 13:27:19.595364 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: action_args: {'id': '540ac816-895b-4737-8d42-9b2c7817f334'} Oct 24 13:27:19.596244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:27:19.596244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:19.596244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:27:19.596244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:27:19.596244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:27:19.596244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:27:19.596244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:27:19.596244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:27:19.596244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:27:19.596244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:27:19.596244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 540ac816-895b-4737-8d42-9b2c7817f334 could not be found. Oct 24 13:27:19.596244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:27:19.596244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:27:19.596244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:27:19.596244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:19.596244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:27:19.596244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:27:19.596244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:27:19.596244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:27:19.596244 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:27:19.597682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:27:19.597682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 24 13:27:19.597682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 24 13:27:19.597682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 24 13:27:19.597682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 24 13:27:19.597682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:27:19.597682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:27:19.597682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:27:19.597682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:27:19.597682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 540ac816-895b-4737-8d42-9b2c7817f334 could not be found. Oct 24 13:27:19.597682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:27:19.597682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:27:19.597682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:27:19.597682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:19.597682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:27:19.597682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:27:19.597682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:27:19.597682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:27:19.597682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 540ac816-895b-4737-8d42-9b2c7817f334 could not be found. Oct 24 13:27:19.597682 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: ERROR nova.api.openstack.wsgi Oct 24 13:27:19.599133 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-e2129099-fc11-40ec-8dc0-81bff875bf35 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Returning 404 to user: Instance 540ac816-895b-4737-8d42-9b2c7817f334 could not be found. {{(pid=118915) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:27:19.599133 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-e2129099-fc11-40ec-8dc0-81bff875bf35 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "DELETE /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334" status: 404 len: 111 microversion: 2.1 time: 0.030728 Oct 24 13:27:19.599133 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 528/1083] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Oct 24 13:27:19 2022] DELETE /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 24 13:27:19.603511 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d657fad7-5c49-4844-9e21-c483cf31fd57 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '>' {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:19.604140 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.compute.api [None req-d657fad7-5c49-4844-9e21-c483cf31fd57 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] [instance: 540ac816-895b-4737-8d42-9b2c7817f334] Fetching instance by UUID {{(pid=118914) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 24 13:27:19.610926 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d657fad7-5c49-4844-9e21-c483cf31fd57 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:19.611431 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d657fad7-5c49-4844-9e21-c483cf31fd57 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:19.611857 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d657fad7-5c49-4844-9e21-c483cf31fd57 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:19.612542 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d657fad7-5c49-4844-9e21-c483cf31fd57 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Acquiring lock "acff14a8-a78e-4539-91cc-32485716dc9b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 24 13:27:19.612992 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d657fad7-5c49-4844-9e21-c483cf31fd57 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 24 13:27:19.613411 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG oslo_concurrency.lockutils [None req-d657fad7-5c49-4844-9e21-c483cf31fd57 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Lock "acff14a8-a78e-4539-91cc-32485716dc9b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 24 13:27:19.629028 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.wsgi [None req-d657fad7-5c49-4844-9e21-c483cf31fd57 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] HTTP exception thrown: Instance 540ac816-895b-4737-8d42-9b2c7817f334 could not be found. Oct 24 13:27:19.630507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d657fad7-5c49-4844-9e21-c483cf31fd57 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Request method failure captured: Oct 24 13:27:19.630507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: request: GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 HTTP/1.1 Oct 24 13:27:19.630507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept: application/json Oct 24 13:27:19.630507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Accept-Encoding: identity Oct 24 13:27:19.630507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Connection: close Oct 24 13:27:19.630507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Length: 0 Oct 24 13:27:19.630507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Content-Type: application/json Oct 24 13:27:19.630507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Host: 10.222.0.42 Oct 24 13:27:19.630507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: Openstack-System-Scope: None Oct 24 13:27:19.630507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: User-Agent: python-urllib3/1.26.12 Oct 24 13:27:19.630507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Auth-Token: gAAAAABjVpEilMaq7mAXZHY4orOYYZmWyICm8ZHjnejcM_953w-RaE7YGocX30NOBhp8jtyJCAyHvKmNnpfTnH1FQ1PV3Ro--_ykDkPAtHFZT6g_IIH_Yt6r2AFI6TxvFSQPYV10WjGOb2Ffc6sSbVPjxu1Awzv4TfPYTIEghsJnziZjbVEWMCw Oct 24 13:27:19.630507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Id: None Oct 24 13:27:19.630507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Domain-Name: None Oct 24 13:27:19.630507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Identity-Status: Confirmed Oct 24 13:27:19.630507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Is-Admin-Project: True Oct 24 13:27:19.630507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Id: default Oct 24 13:27:19.630507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Domain-Name: Default Oct 24 13:27:19.630507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Id: e5f4729aa5f44fe08096bed3438e8f7e Oct 24 13:27:19.630507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Project-Name: tempest-TestVolumeBootPattern-1997881197 Oct 24 13:27:19.630507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Role: member,reader Oct 24 13:27:19.630507 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Roles: member,reader Oct 24 13:27:19.632245 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e5f4729aa5f44fe08096bed3438e8f7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5f4729aa5f44fe08096bed3438e8f7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e5f4729aa5f44fe08096bed3438e8f7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e5f4729aa5f44fe08096bed3438e8f7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 24 13:27:19.632245 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant: tempest-TestVolumeBootPattern-1997881197 Oct 24 13:27:19.632245 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Id: e5f4729aa5f44fe08096bed3438e8f7e Oct 24 13:27:19.632245 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-Tenant-Name: tempest-TestVolumeBootPattern-1997881197 Oct 24 13:27:19.632245 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User: tempest-TestVolumeBootPattern-1997881197-project Oct 24 13:27:19.632245 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Id: default Oct 24 13:27:19.632245 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Domain-Name: Default Oct 24 13:27:19.632245 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Id: 1fe85edb1188403d84072d19128e07d5 Oct 24 13:27:19.632245 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: X-User-Name: tempest-TestVolumeBootPattern-1997881197-project Oct 24 13:27:19.632245 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: method: > Oct 24 13:27:19.632245 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: exception: Instance 540ac816-895b-4737-8d42-9b2c7817f334 could not be found. Oct 24 13:27:19.632245 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: action_args: {'id': '540ac816-895b-4737-8d42-9b2c7817f334'} Oct 24 13:27:19.633499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: {{(pid=118914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 24 13:27:19.633499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:19.633499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 24 13:27:19.633499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 24 13:27:19.633499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 24 13:27:19.633499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 24 13:27:19.633499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 24 13:27:19.633499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 24 13:27:19.633499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 24 13:27:19.633499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 24 13:27:19.633499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 540ac816-895b-4737-8d42-9b2c7817f334 could not be found. Oct 24 13:27:19.633499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:27:19.633499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:27:19.633499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:27:19.633499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:19.633499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:27:19.633499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:27:19.633499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 24 13:27:19.633499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 24 13:27:19.633499 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 24 13:27:19.635389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 24 13:27:19.635389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 24 13:27:19.635389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 24 13:27:19.635389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 24 13:27:19.635389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 24 13:27:19.635389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 24 13:27:19.635389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 24 13:27:19.635389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 540ac816-895b-4737-8d42-9b2c7817f334 could not be found. Oct 24 13:27:19.635389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:27:19.635389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 24 13:27:19.635389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:27:19.635389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 24 13:27:19.635389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 24 13:27:19.635389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 24 13:27:19.635389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 24 13:27:19.635389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 24 13:27:19.635389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 540ac816-895b-4737-8d42-9b2c7817f334 could not be found. Oct 24 13:27:19.635389 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: ERROR nova.api.openstack.wsgi Oct 24 13:27:19.637192 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: DEBUG nova.api.openstack.wsgi [None req-d657fad7-5c49-4844-9e21-c483cf31fd57 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Returning 404 to user: Instance 540ac816-895b-4737-8d42-9b2c7817f334 could not be found. {{(pid=118914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 24 13:27:19.637192 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: INFO nova.api.openstack.requestlog [None req-d657fad7-5c49-4844-9e21-c483cf31fd57 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334" status: 404 len: 111 microversion: 2.1 time: 0.032234 Oct 24 13:27:19.637192 dv-cinder-862489-1-iscsi devstack@n-api.service[118914]: [pid: 118914|app: 0|req: 556/1084] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Oct 24 13:27:19 2022] GET /compute/v2.1/servers/540ac816-895b-4737-8d42-9b2c7817f334 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 24 13:27:20.933142 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: DEBUG nova.api.openstack.wsgi [None req-b4a17d34-cbcc-41ba-aecf-17c49d89a226 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] Calling method '.version_select at 0x7fad28756ee0>' {{(pid=118915) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 24 13:27:20.957074 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: INFO nova.api.openstack.requestlog [None req-b4a17d34-cbcc-41ba-aecf-17c49d89a226 tempest-TestVolumeBootPattern-1997881197 tempest-TestVolumeBootPattern-1997881197-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1788078914" status: 202 len: 0 microversion: 2.1 time: 0.027523 Oct 24 13:27:20.959092 dv-cinder-862489-1-iscsi devstack@n-api.service[118915]: [pid: 118915|app: 0|req: 529/1085] 10.222.0.42 () {58 vars in 1263 bytes} [Mon Oct 24 13:27:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1788078914 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)